About Git Hub: As the global home for all developers, Git Hub is the complete AI-powered developer platform to build, scale, and deliver secure software. Over 100 million people, including developers from 90 of the Fortune 100 companies, use Git Hub to build amazing things together across 330+ million repositories. With all the collaborative features of Git Hub, it has never been easier for individuals and teams to write faster, better code.
Locations: In this role you can work from Remote, United States
Overview:Git Hub Copilot has changed the way software is built, and we have a unique opportunity to look further ahead to identify how software development can be faster, safer, easier, and more accessible. We’re looking for talented and passionate Applied Scientists to join us in this mission!
Our organization, Git Hub Copilot Applied Science, plays a crucial role in advancing the core intelligence that powers Copilot. Our responsibilities encompass various areas such as LLM fine-tuning generation, prompt engineering, robust offline and online evaluation, and the development of end-to-end AI features using cutting-edge technologies. In this role, you will collaborate closely with a diverse and highly skilled group of researchers, scientists, and software engineers within our team, while partnering with multiple teams across Git Hub and Microsoft. Together, we are dedicated to shaping the future of software development by continuously enhancing AI-powered capabilities in Copilot.
If you are passionate about generative AI, love solving complex problems, and want to push the boundaries of what’s possible in software development, we’d love to hear from you!

Responsibilities:

• Develop and apply cutting-edge generative AI techniques to improve Git Hub Copilot’s capabilities, including tasks like retrieval-augmented generation (RAG), testing new models, and optimizing prompt engineering strategies.
  
• Design, develop, and maintain a comprehensive offline evaluation framework for Copilot, ensuring robust and scalable methodologies for assessing model performance across diverse datasets and tasks.
  
• Conduct A/B experiments to evaluate the impact of product changes, ensuring continuous refinement and advancement.
  
• Collaborate closely with fellow researchers, scientists, and engineers, and partner with cross-functional teams across Git Hub and Microsoft to drive innovation and ensure the delivery of impactful solutions.
  

Qualifications: Required Qualifications:

• 2+ years experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining production software coding in languages including, but not limited to, C, C++, C#, Java, Java Script, Go, Ruby, Rust, or Python
  
  • OR Associate’s Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 1+ year(s) experience
    
  • OR Bachelor's Degree in Computer Science or related field
    
  • OR equivalent experience
    

• 1+ years of hands-on experience in applied science, machine learning, deep learning, natural language processing or large-scale data mining.
  
• 2+ years of strong programming skills in Type Script or Python or Java Script and experience with relevant libraries and frameworks.
  

Preferred Qualifications:
These are more specific abilities we’re looking for, but it is the rare human who possesses them all. Think of this as a descriptive sketch, not a checklist of requirements. Be comfortable applying even if you don’t have all of them.

• Experience working with generative AI for code
  
• Experience working with LLMs
  
• Proficiency in Typescript
  
• Familiarity with Azure and/or Git Hub Actions
  
• Experience working with a remote, distributed team
  
• Excellent written and verbal communication skills, with the ability to collaborate effectively in a multidisciplinary team
  
• Excellent analytical and problem-solving skills with strong attention to detail

Compensation Range: The base salary range for this job is USD $81,000.00 - USD $214,900.00 /Yr.

These pay ranges are intended to cover roles based across the United States. An individual's base pay depends on various factors including geographical location and review of experience, knowledge, skills, abilities of the applicant. At Git Hub certain roles are eligible for benefits and additional rewards, including annual bonus and stock. These rewards are allocated based on individual impact in role. In addition, certain roles also have the opportunity to earn sales incentives based on revenue or utilization, depending on the terms of the plan and the employee's role. Git Hub Leadership Principles: Git Hub values

• Customer-obsessed
• Ship to learn
• Growth mindset
• Own the outcome
• Better together
• Diverse and inclusive

Manager fundamentals

• Model
• Coach
• Care

Leadership principles

• Create clarity
• Generate energy
• Deliver success

Who We Are: Git Hub is the world’s leading AI-powered developer platform with 100 million developers and counting. We’re also home to the biggest open-source community on earth (and 99% of the world’s software has open-source code in its DNA). Many of the apps and programs you use every day are built on Git Hub.
Our teams are dreamers, doers, and pioneers, leading the way in AI, driving humanitarian efforts around the globe, and even sending open source to Mars (and beyond!). At Git Hub, our goal is to create the space you need to do your best work. We’re remote-first and offer competitive pay, generous learning and growth opportunities, and excellent benefits to support you, wherever you are—because we know that people flourish when they can work on their own terms.
Join us, and let’s change the world, together.
EEO Statement: Git Hub is made up of people from a wide variety of backgrounds and lifestyles. We embrace diversity and invite applications from people of all walks of life. We don't discriminate against employees or applicants based on gender identity or expression, sexual orientation, race, religion, age, national origin, citizenship, disability, pregnancy status, veteran status, or any other differences. Also, if you have a disability, please let us know if there's any way we can make the interview process better for you; we're happy to accommodate!