Software Engineer II - AI Engineering
Company: Microsoft
Location: Toronto, Ontario, Canada
Salary: CA$85.8K – CA$169.3K a year
Work arrangement: Fully remote
Employment type: Full-time
Experience: 2-5 years
Education: bachelor degree
Posted: 2026-11-21
Responsibilities
Design, build, and deploy AI-enabled applications, including conversational agents and enterprise workflow integrations. Collaborate with cross-functional teams to implement secure, scalable AI solutions while monitoring production performance and quality.
Requirements
Requires a Bachelor's degree in Computer Science or a related field and at least 2 years of technical engineering experience. Candidates must demonstrate proficiency in programming languages such as C#, Java, or Python and possess hands-on experience with AI development.
Skills
- Software Engineering
- Generative AI
- LLMs
- Agentic Technologies
- Microsoft Copilot Studio
- Azure OpenAI
- Python
- C#
- Java
- JavaScript
- API Development
- Cloud-native Engineering
- Machine Learning
- CI/CD
- Azure
- Data Engineering
About this role
Overview
Microsoft Customer and Partner Solutions-Core (MCAPS) accelerates customer outcomes and business growth. By uniting product, engineering, marketing, sales, customer success, and partners around a common customer mission, we help customers realize value faster and turn innovation into measurable business impact. Through deep technical expertise and differentiated go-to-market execution, we win competitively, capture market share, and scale repeatable growth motions. We differentiate through value creation - delivering world-class, AI-powered customer experiences that accelerate adoption, strengthen loyalty, and create sustainable competitive advantage, driving growth that outpaces the market.
Innovation & Technology Programs (ITP) turns Microsoft’s business priorities into scalable technology solutions. ITP brings together technology strategy, program delivery, engineering, architecture, disruptive innovation, and AI-enabled productivity to deliver today’s priorities while building the capabilities needed for what comes next. Within ITP, the Disruptive Technology Programs (DTP) team focuses on what could come next. DTP explores, incubates, and validates emerging technologies and transformational ideas, using rapid experimentation and evidence to determine which bets should advance. Successful innovations transition into broader programs for production and scale, giving DTP engineers the opportunity to turn emerging technology into solutions with real-world impact.
We are looking for Software Engineers to build the next generation of AI-powered applications and agentic experiences.
You will combine strong software engineering fundamentals with hands-on AI development to build secure, scalable and reliable solutions using Generative AI, LLMs and agentic technologies. AI is a core engineering competency for this role, both in the products you build and in how you approach software development
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
Design, build, test, deploy, and support AI-enabled applications, custom web applications, APIs, copilots, autonomous/conversational AI agents, automations, and enterprise workflow integrations.
· Create agents using Microsoft Copilot Studio and extend them through topics, generative orchestration, knowledge sources, actions, connectors, Power Automate flows, APIs, and enterprise systems.
· Design custom AI agents using Azure OpenAI or other approved model services, with prompt and context engineering, structured outputs, tool or function calling, grounding, guardrails, session management, and human escalation.
· Design multi-agent solutions in which specialized agents collaborate through routing, planning, shared context, tool selection, hand-offs, retries, and controlled orchestration.
· Experience applying AI-first development practices, such as AI-assisted coding, agentic workflows, and AI-driven testing and code review, and building them into golden paths and standards that teams adopt by default.
· Build focused proofs of concept to validate feasibility and convert successful prototypes into maintainable production solutions using source control, automated testing, configuration management, CI/CD, observability, and release practices.
· Implement security, privacy, least-privilege access, Responsible AI, human oversight, auditability, secrets management, and data-handling requirements.
· Monitor production usage, model and data drift, quality, latency, reliability, failures, telemetry, and cost, and continuously optimize the solution.
· Document solution architecture, data flows, APIs, model assumptions, dependencies, risks, limitations, operating procedures, support ownership, and deployment evidence.
· Collaborate with architects, product owners, project managers, data engineers, data scientists, UX engineers, DevOps teams, security and privacy teams, and business subject-matter experts.
Qualifications
Required/minimum qualifications
Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Additional Preferred Qualifications:
Hands-on experience building APIs, backend services, custom web applications, data integrations, automated tests, and production deployments.
Practical experience with Microsoft Copilot Studio, including agent configuration, knowledge grounding, actions, connectors, orchestration, testing, analytics, and lifecycle management.
Experience designing custom conversational AI or LLM-enabled applications using Azure OpenAI, Azure AI Foundry, or comparable enterprise AI services.
Troubleshooting, documentation, communication, and cross-functional collaboration skills.
Familiarity with the Microsoft engineering toolchain and services, such as Azure, GitHub and GitHub Copilot, Azure DevOps, Microsoft 365, Dynamics 365, and Power Platform.
Hands-on Machine Learning experience across problem framing, exploratory data analysis, feature engineering, supervised and/or unsupervised learning, model evaluation, explainability, deployment, and monitoring.
Experience working with structured and unstructured data, SQL, data transformations, data quality controls, APIs, and secure data-access patterns.
Understanding of cloud-native engineering, identity and access management, configuration and secrets management, telemetry, CI/CD, containers, and environment promotion.
Understanding of evaluation methods for agents, LLM applications, and Machine Learning systems, including automated and human evaluation, regression testi...
About Microsoft
Software Development · 10,001+ employees · headquartered in Redmond, Washington