We are seeking a Hands-On Software Engineer to join our expanding team and lead the design, development, and deployment of cutting-edge generative AI solutions built on our modern technology stack. This role is ideal for a seasoned backend developer with a passion for AI and cloud-native solutions who thrives in a hands-on, collaborative environment. You’ll be at the forefront of developing innovative, scalable, and impactful AI-driven products in partnership with a dynamic, highly skilled team.
We are Giga Spaces, a global pioneer of in-memory computing, building one of the market’s first Digital Integration Hubs (DIH) —an out-of-the-box solution that simplifies digital transformation, and a pioneering e RAG (Enterprise Retrieval Augmented Generation), a technology that aims to enable LLMs to query structured enterprise data with human-level accuracy.
With offices in the US, Europe and Israel, Giga Spaces partners with IBM, Capgemini and Cognizant, and serves customers such as Morgan Stanley, Bank of America, CSX, Goldman Sachs, Société Générale, Credit Agricole, American Airlines, Avanza Bank, CLSA, Stellantis, and UBS.
This position is full time, hybrid and located in our main office in Herzliya.
Responsibilities:
You'll play a key role in building an exciting Generative AI innovation project.

• Design, develop, and deploy state-of-the-art generative AI solutions with a focus on scalability, performance, and reliability.


• Collaborate with cross-functional teams, including data scientists, Dev Ops, and front-end developers, to build robust, end-to-end AI-driven systems.


• Work on complex backend systems using modern microservices architecture and cloud platforms, primarily over AWS and Azure K8s clusters.


• Play a key role in optimizing the backend infrastructure for performance and scalability while contributing to architectural decisions and best practices.


• Integrate and enhance data streaming technologies to support real-time data processing and AI model operations.


• Utilize monitoring and logging tools such as Grafana and Loki to maintain system health, security, and observability.


• Mentor and collaborate with other team members, fostering a culture of knowledge sharing, innovation, and continuous improvement.
• Participate in code reviews, follow best practices for code quality, documentation, and security, and maintain a strong sense of ownership for assigned tasks.

Must-Have Requirements:

• 8+ years of experience in software engineering, with a strong background in Python and experience with microservices architecture
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proficient in SQL and No SQL databases, with knowledge of server-client architectures.
• Experience deploying and managing applications in cloud-native environments (AWS/Azure).
• Strong expertise in Kubernetes environments (e.g., K8s, Open Shift, EKS) and microservices architecture, including designing, deploying, and managing complex containerized applications at scale.
• Familiarity with Agile development methodologies and comfort working in a fast-paced, iterative environment.
• Strong initiative with a sense of ownership to fix issues and optimize systems across the platform.
• Effective communication and collaboration skills, with a proactive, solutions-driven approach to challenges.
• Mentor and collaborate with other team members, fostering a culture of knowledge sharing, innovation, and continuous improvement.

Nice-to-Have Skills:

• Exposure to generative AI frameworks (e.g., Lang Chain, Llama Index) and vector databases (e.g., Milvus, Pinecone).
• Familiarity with LLMs, embedding models, and popular LLM hubs like Hugging Face.
• Experience with observability, including tools such as Grafana, Loki, or similar.
• Knowledge of data streaming technologies (e.g., Kafka) and their role in high-performance data pipelines.