Software Development Engineer in Test - Agentic Automation

Location: Remote in Canada, including Alberta, Ontario, Nova Scotia, New Brunswick, British Columbia, or Manitoba

Base salary: CAD 120,000–170,000 per year, plus variable/incentive compensation, equity, and benefits.

Company

CrowdStrike is a cybersecurity company operating an AI-native platform that processes large-scale distributed security data.

What you will do

• Design, develop, and maintain functional, integration, performance, and automation test suites for distributed cloud systems.
• Extend agentic test-generation and analysis tooling and build AI-powered workflows for test-data setup, failure triage, and release validation.
• Maintain eval suites, golden datasets, scoring pipelines, and CI eval gates for AI agents.
• Detect unreliable AI output, including hallucinated assertions, flaky or redundant tests, incorrect triage, and judge bias.
• Design and analyze performance, load, and stress tests, and validate platform integrations and customer-facing features end to end.
• Review product, system, and agent designs for testability and evaluability and contribute to quality standards.

Requirements

• Degree in Computer Science or equivalent experience, with knowledge of OOP, data structures, algorithms, and distributed systems.
• 5+ years in software quality, including 3+ years of hands-on SDET or test automation development.
• Strong programming skills in at least one of Java, Node.js, or Python; Python is preferred for eval and agent work.
• Experience designing, building, and maintaining test frameworks integrated with CI/CD pipelines such as Jenkins or GitLab CI/CD.
• Experience testing web services and APIs, including REST, gRPC, and JSON.
• Hands-on performance and load-testing experience with tools such as Locust or k6, including realistic workload design and interpretation of latency percentiles, throughput, and error rates.
• A verification-first approach to AI output and the ability to choose between deterministic assertions and probabilistic evaluation.
• Experience using AI technologies to improve decision-making, workflows, efficiency, and business outcomes.
• Must maintain legal entitlement to work in Canada; selected applicants are subject to background checks.

Nice to have

• End-to-end eval-driven development experience, including release gating, trajectory and tool-use evaluations, and calibration of LLM-as-judge systems against human review.
• Prompt engineering and context or tool design for agents.
• Experience integrating performance tests into CI/CD and using observability tools such as Grafana, Prometheus, or CloudWatch.
• Background in cybersecurity, threat intelligence, malware analysis, or sandboxing and detonation environments.

Culture & Benefits

• Remote Canadian employment with flexibility and autonomy and an emphasis on responsible AI adoption, experimentation, and innovation.
• Comprehensive physical and mental wellness programs.
• Competitive vacation and holidays, plus paid parental and adoption leave.
• Professional development opportunities, employee networks, neighborhood groups, and volunteer opportunities.
• Equity, variable/incentive compensation, and benefits are included with the base salary.