The Alexa Customer Journeys team is seeking a Language Engineer with experience
in the field of Natural Language Processing, Machine Learning, or Large Language
Models, as well as expertise in handling large data sets and strong analytical
skills. You will play a critical role in innovative projects by driving design
of Alexa features. The key responsibilities are to generate high-quality data
and to run and evaluate experiments, which involves prompt engineering our Large
Language Model for API delivery. You will work closely with engineers,
scientists, and program managers to ensure we're providing the best Alexa
experience for millions of our customers.
As a Language Engineer, you will start by diving deep into a couple of critical
projects across Alexa experiences. You will collaborate with fellow Language
Engineers, Data Scientists, Program Managers, and stakeholders in science,
engineering, and product teams to understand the role data plays in developing
data sets and exemplars that meet customer needs. You will analyze and automate
processes for collecting and annotating LLM inputs and outputs to assess data
quality and measurement.
You will apply state-of-the-art Generative AI techniques to analyze how well our
data represents human language and run experiments to gauge downstream
interactions. You will work collaboratively with other Language Engineers and
Scientists to design and implement principled strategies for data optimization.
Key job responsibilities
- Collaborate with scientists and software engineers to help design APIs and
evaluate performance of LLM's
- Produce and manipulate different types of language data, analyze and provide
efficient solutions
- Design and lead a data collection; define scope and target, provide a
guideline and training, guide teams cross sites to meet the quality bar, and run
evaluation of data for hand off
- Engineer prompts to guide generative AI to produce desired outputs in context
- Automate operations and perform data analysis using Python or other scripting
language
- Advocate strict adherence to annotation guidelines
- Test and deploy changes to Alexa's language understanding codebase
- Identify and solve production issues that are impacting the Alexa customer
experience
- Collaborate with other linguists, scientists, and designers in creating
optimal solutions to elevate the customer experience
- Own the customer-facing machine learning and deterministic models for a
specific domain of features
- Use modeling tools to bootstrap and test new functionalities
