Work Location:
Hours
Line Of Business
Pay Details
Job Description
Key Responsibilities
- Crafting effective prompts that elicit the desired responses from AI models.
- Experimenting with different phrasing and structures to optimize model output.
- Ensuring prompts are clear, concise, and contextually appropriate for the target audience or application.
Data Analysis And Evaluation
- Analyzing model outputs to assess the effectiveness of different prompts.
- Conducting A/B testing and other evaluation methods to compare prompt performance.
- Identifying patterns and trends in AI responses to refine prompt strategies.
User Interaction Design
- Designing prompts that enhance user experience in conversational interfaces.
- Ensuring prompts align with user intents and expectations.
- Collaborating with UX/UI designers to integrate prompts seamlessly into applications.
Model Fine-Tuning
- Collaborating with data scientists and machine learning engineers to fine-tune AI models based on prompt performance.
- Adjusting prompts to improve model accuracy, relevance, and coherence.
- Using feedback loops to iteratively improve prompts and model responses.
Documentation And Knowledge Sharing
- Documenting best practices, guidelines, and methodologies for prompt engineering.
- Sharing insights and findings with cross-functional teams to inform broader AI development efforts.
- Contributing to internal knowledge bases and training materials.
Ethical Considerations
- Ensuring prompts are designed to avoid bias, inappropriate content, and other ethical issues.
- Staying informed about ethical guidelines and industry standards related to AI and prompt engineering.
- Implementing measures to mitigate potential misuse or harmful effects of AI-generated content.
Collaboration And Communication
- Working closely with product managers, developers, linguists, and other stakeholders to align prompt engineering efforts with project goals.
- Communicating complex technical concepts to non-technical team members.
- Participating in team meetings, brainstorming sessions, and collaborative projects.
Continuous Learning And Improvement
- Keeping up to date with the latest advancements in AI, NLP, and prompt engineering techniques.
- Attending workshops and training sessions to enhance skills and knowledge.
- Experimenting with new tools and technologies to improve prompt engineering practices.
Education/Experience
- Bachelor's or Master's degree in computer science, Engineering, Data Science, or a related field.
- 2 years' experience in designing, testing, and optimizing prompts to improve output quality, strengthen prompt security, model performance, and reduce cost.
- Experience with RAG, various document processing \& chunking.
- Experience with programming languages such as Python, and familiarity with NLP libraries and frameworks, e.g. TensorFlow, PyTorch, SpaCy, HuggingFace Transformers, PromptFlow, LangChain, Semantic Kernel.
- Experience with a myriad of LLM, i.e. GPT, LLama, Mistral, Gemini, Claude, Bloom, Phi.
- Experience with vector databases and various ANN search algorithms.
- Experience with integrating LLM into applications via APIs.
- Experience with DevOps practice, version control, GitHub actions, Linux.
- Excellent analytical and problem-solving skills, with a keen attention to detail.
- Strong communication and collaboration skills to work effectively in a team environment.
- Experience with cloud technologies, preferably Azure.
Who We Are
Our Total Rewards Package
Additional Information
Colleague Development
Training \& Onboarding
Interview Process
Accommodation
Language Requirement (Quebec Only)
