Job Details

Altoros is hiring QA Automation Engineer

Job Description

Altoros - an established provider of software development services, is looking for a QA Automation Engineer.

Requirements

Responsibilities & Responsibilities:

It's a part-time position.

Own the test strategy across FE, BE, and LLM/agent workflows; define the test pyramid and coverage goals.
Build and maintain automation for:

UI/E2E flows (critical paths, multi‑step agentic scenarios).
API/contract testing (REST/GraphQL), schema/compatibility checks.
Data & integration tests across services and external partners.

LLM Quality & Evals

Design golden datasets and rubrics for LLM output evaluation (pass/fail thresholds, human‑in‑the‑loop review).
Set up regression/eval harnesses for prompts, tools, and agents; track drift and hallucination rates.
Implement guardrails and adversarial/red‑team tests for safety, privacy, bias, and toxicity.

Non‑functional testing: baseline and monitor performance, reliability, and resilience for key user journeys.
CI/CD ownership: integrate tests into pipelines, gate releases, reduce flakiness, and surface quality KPIs (e.g., failure rate, MTTR, coverage).
Test data & environments: manage fixtures, synthetic data, and stable seeds for deterministic runs.
Quality operations: triage defects, drive root‑cause analysis, and keep crisp, proactive communication with PM, Design, and Engineering.
Documentation: maintain clear test plans, playbooks, and release criteria.

Nice to have:

Experience with agent frameworks, tool calling, retrieval/RAG, or tracing.
Familiarity with evaluation/observability tools for LLM apps (e.g., prompt testing frameworks, tracing dashboards).
Performance testing (e.g., k6/JMeter) and basic security/safety testing practices.

Join Altoros Team!

Apply Link: https://choto.co/oz9mssxz

🚀 Ready to Land Your Dream QA Role?

Top tech companies are hiring — are they hiring you?
Join QABrains, the fastest-growing community of Quality Assurance professionals, and unlock insider opportunities to get hired by FAANG-level companies and startups alike.

[SIGN UP & GET STARTED ➝] — It’s free

🎯 Why Join QAbrains?

✅ Get Noticed by Recruiters from top-tier companies
✅ Showcase Your Skills with a professional profile that stands out
✅ Write Blogs, Join Discussions & Build Authority
✅ Stay Ahead with exclusive testing content, real interview Q&As & expert guides
✅ Network with Real QA Hiring Managers

[SIGN UP & GET STARTED ➝]

💼 Our Members Have Been Hired At:

Google • Amazon • Accenture • Thoughtworks • Infosys • Oracle • Grab • Siemens — and more!

“Signup, set up your profile, write on Qabrains, contribute to QA discussions 👉 paste your qabrains.com profile link on your CV and land on your dream company QA jobs, it is that simple and it works!”
— Wasif, Head of Qabrains.

[SIGN UP & GET STARTED ➝]