GoodVibeCode
Jobs/Senior AI Systems Quality Engineer
AI

Senior AI Systems Quality Engineer

Abacus Insights

Boston, Massachusetts, United StatesFull-time5-10 yearsRemoteRemote OK
Posted 13 hours ago· America/New_York· Boston, Massachusetts, United States

✨ Why This Is a Good Vibe Coding Job

Why This Is a Good Vibe Coding Job: Abacus Insights explicitly calls out 'vibe coding' as a method to iterate on AI behaviors without traditional code heavy-lifting. The role focuses on orchestrating LLM agents and prompt logic, making it perfect for engineers who leverage AI tools like Cursor or Claude to build complex, non-deterministic systems.

The Mission

In this role, you will transition from traditional quality assurance to high-level AI systems engineering. You'll be responsible for building the automated frameworks that ensure healthcare AI agents are reliable, safe, and accurate. Rather than manual testing, you'll be architecting a platform that uses MLflow and Databricks to monitor and validate LLM outputs at scale.

The Tech Stack

  • Languages: Python & TypeScript
  • AI Infrastructure: Agentic workflows, LLM orchestration, and prompt engineering
  • Data & Ops: Databricks Medallion architecture, AWS, and CI/CD pipelines
  • Vibe Coding: You will treat prompts and agent behaviors as versioned, testable assets, using AI-assisted development to move fast.

Career Impact

You’ll be at the forefront of the 'vibe coding' movement, proving that natural language orchestration can meet the rigorous standards of the healthcare industry. This is a remote-first position offering equity and a high degree of autonomy in shaping the future of AI reliability and governance.

Benefits

Unlimited paid time offWork from anywhereComprehensive health coverageEquityGrowth-focused environmentHome office setup allowanceMonthly cell phone allowance

Skills & Tags

PythonTypeScriptDatabricksMLflowLLMAgentic workflowsCI/CDAWSAutomated testingQuality engineeringDistributed systemsData lineageAuditabilityRegression testingPrompt engineeringObservability

Keywords

AI SystemsQuality EngineeringDatabricksMLflowLLMAgentic AIPythonTypeScriptCI/CDAWSMedallion ArchitectureAutomated TestingRegression TestingObservabilityDatadogPrometheusGrafanaHealthcare DataGovernanceSafetyHallucination DetectionBias TestingDistributed SystemsProduction-gradeValidation FrameworksTest HarnessesTraceabilityAuditabilityPrompt EngineeringOrchestration Logic

Categories

TechnologySoftwareData & AnalyticsEngineeringHealthcare

Listing transparency: Job facts are based on the original employer or job-source listing. GoodVibeCode may use AI assistance to summarize and structure the description, followed by editorial checks.

Source: greenhouse

Last reviewed: Sep 29, 2026. How we source and review jobs.