Description:
As an AI/ML Engineer, you will be responsible for designing, developing, and deploying machine learning models within a Databricks environment, leveraging Azure OpenAI Large Language Models (LLMs). You will have hands-on experience with Databricks and its derivative frameworks. Your role will involve building the initial version of the model monitoring framework within Databricks and integrating selected metrics to ensure accurate and real-time monitoring of model performance.
You will collaborate with data scientists, data engineers, and other stakeholders to build scalable and efficient machine learning solutions that drive business value. Proficiency in Agile project methodologies and the ability to multi-task effectively between projects are essential. You will also be responsible for estimating work content, achieving planned timelines, and communicating proposed designs and progress to customers, team leads, and team members.
Key Responsibilities:
- Develop and implement machine learning models using Azure OpenAI LLMs within the Databricks platform.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Optimize and fine-tune models for performance, scalability, and accuracy.
- Integrate machine learning models into existing data pipelines and workflows.
- Conduct data preprocessing, feature engineering, and model evaluation.
- Monitor and maintain deployed models to ensure they perform as expected in production.
- Gather requirements and analyze the LLM validation process.
- Design and architect solutions for validating LLM performance and migrating to newer LLMs.
- Develop and implement processes for switching to newer LLMs, ensuring minimal disruption to existing workflows.
- Test and validate running older and newer LLMs side by side.
- Document and transfer knowledge covering the framework’s design, implementation, and usage.
- Plan and develop extensions to the framework.
- Stay up-to-date with the latest advancements in machine learning and AI technologies.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
- Proven experience in machine learning, natural language processing, and working with large datasets.
- Proficiency in Python and familiarity with machine learning libraries such as TensorFlow, PyTorch, or scikit-learn.
- Strong understanding of Databricks.
- Proficiency in Azure OpenAI LLMs and their applications.
- Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
Next steps
If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you! Please apply directly with us.
For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers
Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.
The Cognizant community:
We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.
- Cognizant is a global community with more than 300,000 associates around the world.
- We don’t just dream of a better way – we make it happen.
- We take care of our people, clients, company, communities and climate by doing what’s right.
- We foster an innovative environment where you can build the career path that’s right for you.
About us:
Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World’s Best Employers 2024) is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com
Our commitment to diversity and inclusion:
Cognizant is an equal opportunity employer that embraces diversity, champions equity and values inclusion. We are dedicated to nurturing a community where everyone feels heard, accepted and welcome. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other protected characteristic as outlined by federal, state or local laws.
Disclaimer:
Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.