← Back to history

Pipeline run

3412d728-0676-44d7-a53e-9fcec73e8f1f

Pipeline LLM cost (USD)
API 1: $0.0081 API 2: $0.0002 API 3: $0.0000 Total: $0.0083

Client output enrichment

v2 Skill cluster · Nature of work · AI index · Tech stack maturity · Evidence · KRA description
role baseline loaded sources · ai_index: jd · nature_of_work: jd · tech_stack_maturity: jd
Nature of work
Reviews and ranks 3–4 model-generated code diffs per task, checking correctness, code quality, style, and efficiency, then writes clear rationales and flags edge cases or ambiguities for the team.
""Review and compare 3–4 model-generated code responses for each task using a structured ranking system.""
Tech stack maturity
Mainstream Modern
Hybrid mobile development with code review and git is a common contemporary stack practice, but the provided skills do not indicate bleeding-edge AI-native or cloud-native specialization.
AI index (0 = no AI use, 5 = totally AI-dependent · v2.1)
0.50 / 5
· Title match
Has AI skill
· AI skill (primary)
AI skill (secondary)
· On AI team
· Builds AI products
vocab breakdown (legacy)
Assistants (×1):
Frameworks (×2):
Models / concepts (×3): LLM, LLMs, AI
Evidence — skills matched in JD (7)
Code Review Git LLM Software Design Coding Best Practices Developer Tools Automation Systems
Skill cluster (1 dimension groups, role-scoped)
Cross-cutting / unaligned
Code Review Git LLM Software Design Coding Best Practices Developer Tools Automation Systems
Show KRA description ↓
• Review and compare 3–4 model-generated code responses for each task using a structured ranking system. • Evaluate code diffs for correctness, code quality, style, and efficiency. • Provide clear, detailed rationales explaining the reasoning behind each ranking decision. • Maintain high consistency and objectivity across evaluations. • Collaborate with the team to identify edge cases and ambiguities in model behavior. • At least 3 years of experience at top-tier product or research companies (e.g., Stripe, Datadog, Snowflake, Dropbox, Canva, Shopify, Intuit, PayPal, or research roles at IBM, GE, Honeywell, Schneider, etc.), with a total of 7+ years of overall professional software engineering experience. • Strong fundamentals in software design, coding best practices, and debugging. • Excellent ability to assess code quality, correctness, and maintainability. • Proficient with code review processes and reading diffs in real-world repositories. • Exceptional written communication skills to articulate evaluation rationale clearly. • Prior experience with LLM-generated code or evaluation work is a plus. • Experience in LLM research, developer agents, or AI evaluation projects. • Background in building or scaling developer tools or automation systems.

Signals

Skill
Alias
KRA react-native-developer
0.60

Post-classification

Centroidupdated · n=84
Alias collision log
New-role queue
New skills captured5
New KRA capturedyes

Captured for admin review

LLM Hybrid Mobile Developer pending
Software Design Hybrid Mobile Developer pending
Coding Best Practices Hybrid Mobile Developer pending
Developer Tools Hybrid Mobile Developer pending
Automation Systems Hybrid Mobile Developer pending
R&R fragment (sim 0.00) Hybrid Mobile Developer pending

• Review and compare 3–4 model-generated code responses for each task using a structured ranking system. • Evaluate code diffs for correctness, code quality, style, and efficiency. • Provide clear, de…

Status: completed Created: 2026-05-27T17:41:27.597600Z Updated: 2026-06-07T08:00:53.575443Z API 3 duration: 2967 ms
Flow Current 3-step pipeline

1 POST /skills/extract-from-jd

2 POST /skills/extract-details

3 POST /skills/final-role-output

Role Chosen role & resolution

Hybrid Mobile Developer

React Native Developer

sub-role · 0.60 CASE B

slug: hybrid-mobile-developer · id: 11 · source: db · sub-role slug: react-native-developer

KRA-led classification on react-native-developer (skill weak, KRA 0.60)

Resolution: in_db — role exists in library; skill↔dim and role↔dim links saved when applicable.

0
New skills
0
Skill↔dim saved
0
Role↔dim saved
1
Skipped

Job description

About Us:
Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.


Project Overview:
We're building high-quality evaluation and training datasets to improve how Large Language Models (LLMs) interact with realistic software engineering tasks. A key focus of this project is curating verifiable software engineering challenges from public GitHub repository histories using a human-in-the-loop process.


Why This Role Is Unique:
• Collaborate directly with AI researchers shaping the future of AI-powered software development.
• Work with high-impact open-source projects and evaluate how LLMs perform on real bugs, issues, and developer tasks.
• Influence dataset design that will train and benchmark next-gen LLMs.


What does day-to-day look like:
• Review and compare 3–4 model-generated code responses for each task using a structured ranking system.
• Evaluate code diffs for correctness, code quality, style, and efficiency.
• Provide clear, detailed rationales explaining the reasoning behind each ranking decision.
• Maintain high consistency and objectivity across evaluations.
• Collaborate with the team to identify edge cases and ambiguities in model behavior.


Required Skills:
• At least 3 years of experience at top-tier product or research companies (e.g., Stripe, Datadog, Snowflake, Dropbox, Canva, Shopify, Intuit, PayPal, or research roles at IBM, GE, Honeywell, Schneider, etc.), with a total of 7+ years of overall professional software engineering experience.
• Strong fundamentals in software design, coding best practices, and debugging.
• Excellent ability to assess code quality, correctness, and maintainability.
• Proficient with code review processes and reading diffs in real-world repositories.
• Exceptional written communication skills to articulate evaluation rationale clearly.
• Prior experience with LLM-generated code or evaluation work is a plus.


Bonus Points:
• Experience in LLM research, developer agents, or AI evaluation projects.
• Background in building or scaling developer tools or automation systems.


Engagement Details:
• Commitment: ~20 hours/week (partial PST overlap required)
• Type: Contractor (no medical/paid leave)
• Duration: 1 month (starting next week; potential extensions based on performance and fit)
• Rates: $40–$100/hour, based on experience and skill level.

Skills from this JD

Each row merges API 1 extraction, API 2 library match / v3 orchestration (dimensions + locked dims), and API 3 persistence tags.

LLM Secondary Library skill API 3: existing canonical (in_db) Existing skill (matched library)
Canonical: LLMs id=1193 · llms

Aliases — catalog

  • LLMs (CANONICAL)

Context tags (catalog)

BERT GPT NLP attention mechanism contextual embeddings fine-tuning language generation model training pre-trained models prompt engineering text classification tokenization transfer learning transformers zero-shot learning

Stored enrichment (catalog DB)

Category
Concept
Sub-category
Large Language Models
Confidence
0.96
Version strategy
NOT_APPLICABLE

Maturity reasoning: LLMs are increasingly listed in job descriptions for AI/ML and product roles, and major vendors (OpenAI, Anthropic, Google) are shipping APIs and platforms, but they are not yet universal across engineering hiring.

Skill profile (library / DB)

Skill nature
CONCEPT
Volatility
EMERGING
Typical lifespan
EVERGREEN
Category id
2
Sub-category id
903
Extractable
True
Also category
False

Dimensions (API 2 worklist)

  • React Frontend Development Catalog dimension db id 96

    Library dimension (catalog)

API 3 link attempts (this skill)

Dimension Skill↔dim Role↔dim Outcome
React Frontend Development
d_init_01
Skipped — no persistable v3 meta for new skill
skill_not_in_db_v3_proposed
Code Review Primary Library skill API 3: existing canonical (in_db) Existing skill (matched library)
Canonical: Code Review id=516 · code-review

Aliases — catalog

  • Code Review (CANONICAL)

Context tags (catalog)

Bitbucket GitHub GitLab PR review approval workflow branch protection code quality diff inline comments linting merge request pair programming pull request review checklist static analysis

Stored enrichment (catalog DB)

Category
SoftSkill
Sub-category
Code Review
Confidence
0.96
Version strategy
NOT_APPLICABLE

Maturity reasoning: Code review is a standard hiring-pipeline requirement in engineering JDs and is built into major platforms like GitHub/GitLab pull-request workflows, indicating broad adoption.

Skill profile (library / DB)

Skill nature
PRACTICE
Volatility
STABLE
Typical lifespan
EVERGREEN
Category id
58
Sub-category id
364
Extractable
True
Also category
False

Dimensions (API 2 worklist)

  • React Frontend Development Catalog dimension db id 96

    Library dimension (catalog)

API 3 link attempts (this skill)

Dimension Skill↔dim Role↔dim Outcome
React Frontend Development
d_init_01
Existing dimension (library) · Role↔dimension skipped (dimension not under chosen role)
Git Primary Library skill API 3: existing canonical (in_db) Existing skill (matched library)
Canonical: Git id=1002 · git

Aliases — catalog

  • Git (CANONICAL)

Context tags (catalog)

CI/CD GitHub GitLab branching checkout clone commit fork merging pull request rebase remote repository stash versioning

Stored enrichment (catalog DB)

Category
Tool
Sub-category
Version Control Tool
Vendor
Linus Torvalds
License
gpl_v2
Year introduced
2005
Confidence
0.99
Version strategy
NOT_APPLICABLE

Maturity reasoning: Git is a hiring-pipeline staple: it appears in the vast majority of software engineering job descriptions and is the default VCS on GitHub/GitLab/Bitbucket.

Skill profile (library / DB)

Skill nature
TOOL
Volatility
STABLE
Typical lifespan
EVERGREEN
Category id
13
Sub-category id
730
Extractable
True
Also category
False

Dimensions (API 2 worklist)

  • React Frontend Development Catalog dimension db id 96

    Library dimension (catalog)

API 3 link attempts (this skill)

Dimension Skill↔dim Role↔dim Outcome
React Frontend Development
d_init_01
Existing dimension (library) · Role↔dimension skipped (dimension not under chosen role)
Software Design Secondary New / orchestrated API 3: new canonical path (new) New / unmatched skill (orchestrated in API 2)

Skill enrichment (orchestrator / LLM)

No Stage 7 enrichment blob on this skill (orchestrator skipped enrichment).

Derived legacy fields
Category
Conceptual Frameworks
Sub-category
general
Skill nature
CONCEPT
Volatility
STABLE
Typical lifespan
EVERGREEN
Version strategy
UNVERSIONED
Coding Best Practices Secondary New / orchestrated API 3: new canonical path (new) New / unmatched skill (orchestrated in API 2)

Skill enrichment (orchestrator / LLM)

No Stage 7 enrichment blob on this skill (orchestrator skipped enrichment).

Derived legacy fields
Category
Soft Skills
Sub-category
general
Skill nature
PRACTICE
Volatility
MEDIUM
Typical lifespan
MULTI_YEAR
Version strategy
UNVERSIONED
Developer Tools Secondary New / orchestrated API 3: new canonical path (new) New / unmatched skill (orchestrated in API 2)

Skill enrichment (orchestrator / LLM)

No Stage 7 enrichment blob on this skill (orchestrator skipped enrichment).

Derived legacy fields
Category
DevOps Tools
Sub-category
general
Skill nature
TOOL
Volatility
MEDIUM
Typical lifespan
MULTI_YEAR
Version strategy
UNVERSIONED
Automation Systems Secondary New / orchestrated API 3: new canonical path (new) New / unmatched skill (orchestrated in API 2)

Skill enrichment (orchestrator / LLM)

No Stage 7 enrichment blob on this skill (orchestrator skipped enrichment).

Derived legacy fields
Category
Infrastructure Tools
Sub-category
general
Skill nature
PLATFORM
Volatility
MEDIUM
Typical lifespan
MULTI_YEAR
Version strategy
UNVERSIONED

All API 3 persistence rows

Same grid as the skill-extractor “Persistence items” table: one row per (skill × dimension) work item.

Skill Tag Dimension Skill↔dim Role↔dim Outcome Notes
LLM new
React Frontend Development
d_init_01
Skipped — no persistable v3 meta for new skill skill_not_in_db_v3_proposed
Code Review in_db
React Frontend Development
d_init_01
Existing dimension (library) · Role↔dimension skipped (dimension not under chosen role)
Git in_db
React Frontend Development
d_init_01
Existing dimension (library) · Role↔dimension skipped (dimension not under chosen role)

Library artifacts (this run)

Kind Detail DB id
canonical_skill_proposed Software Design | type=Conceptual Frameworks subtype=general nature=CONCEPT lifespan=EVERGREEN
canonical_skill_proposed Coding Best Practices | type=Soft Skills subtype=general nature=PRACTICE lifespan=MULTI_YEAR
canonical_skill_proposed Developer Tools | type=DevOps Tools subtype=general nature=TOOL lifespan=MULTI_YEAR
canonical_skill_proposed Automation Systems | type=Infrastructure Tools subtype=general nature=PLATFORM lifespan=MULTI_YEAR
dimension_skill_link_proposed LLM ↔ React Frontend Development
nano JD Parser — gpt-4.1-nano click to toggle
RoleAI Evaluation Contractor
CompanyTuring
Experience7+ years of overall professional software engineering experience
CTC{'max': 100, 'min': 40, 'raw': '$40–$100/hour', 'period': 'hourly', 'currency': 'USD'}
DomainSoftware & SaaS Products
JD type pass
Show raw JSON
{
  "JD_type": "pass",
  "about_company": {
    "source_marker": {
      "first_5_words": "Turing is one of the",
      "last_5_words": "and frontier AI."
    },
    "text": "Turing is one of the world\u2019s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You\u2019ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.",
    "word_count": 64
  },
  "archetype_override_applied": true,
  "archetype_override_matched_skills": [
    "open-source",
    "Snowflake",
    "code quality",
    "GitHub",
    "Code Review",
    "Datadog",
    "LLMs",
    "Evaluation",
    "scaling",
    "Role",
    "Edge",
    "Models",
    "Repositories",
    "roles",
    "Task",
    "debugging"
  ],
  "certifications": [],
  "company_name": "Turing",
  "ctc": {
    "currency": "USD",
    "max": 100,
    "min": 40,
    "period": "hourly",
    "raw": "$40\u2013$100/hour"
  },
  "domain": {
    "primary": {
      "aliases": [
        "SaaS",
        "Software Development"
      ],
      "domain": "Software \u0026 SaaS Products"
    },
    "secondary": null
  },
  "education": [],
  "experience": {
    "max": null,
    "min": 7,
    "raw": "7+ years of overall professional software engineering experience"
  },
  "job_locations": [],
  "role": "AI Evaluation Contractor",
  "role_aliases": [
    "AI Evaluator",
    "Contractor for AI Evaluation"
  ],
  "role_archetype": "Engineering",
  "roles_and_responsibilities": [
    {
      "bullet_count": 5,
      "heading": "What does day-to-day look like",
      "heading_was_present": true,
      "source_marker": {
        "first_5_words": "\u2022 Review and compare 3\u20134",
        "last_5_words": "and ambiguities in model behavior."
      },
      "text": "\u2022 Review and compare 3\u20134 model-generated code responses for each task using a structured ranking system.\n\u2022 Evaluate code diffs for correctness, code quality, style, and efficiency.\n\u2022 Provide clear, detailed rationales explaining the reasoning behind each ranking decision.\n\u2022 Maintain high consistency and objectivity across evaluations.\n\u2022 Collaborate with the team to identify edge cases and ambiguities in model behavior.",
      "word_count": 56
    },
    {
      "bullet_count": 6,
      "heading": "Required Skills",
      "heading_was_present": true,
      "source_marker": {
        "first_5_words": "\u2022 At least 3 years of",
        "last_5_words": "or evaluation work is a plus."
      },
      "text": "\u2022 At least 3 years of experience at top-tier product or research companies (e.g., Stripe, Datadog, Snowflake, Dropbox, Canva, Shopify, Intuit, PayPal, or research roles at IBM, GE, Honeywell, Schneider, etc.), with a total of 7+ years of overall professional software engineering experience.\n\u2022 Strong fundamentals in software design, coding best practices, and debugging.\n\u2022 Excellent ability to assess code quality, correctness, and maintainability.\n\u2022 Proficient with code review processes and reading diffs in real-world repositories.\n\u2022 Exceptional written communication skills to articulate evaluation rationale clearly.\n\u2022 Prior experience with LLM-generated code or evaluation work is a plus.",
      "word_count": 104
    },
    {
      "bullet_count": 2,
      "heading": "Bonus Points",
      "heading_was_present": true,
      "source_marker": {
        "first_5_words": "\u2022 Experience in LLM research,",
        "last_5_words": "or scaling developer tools or"
      },
      "text": "\u2022 Experience in LLM research, developer agents, or AI evaluation projects.\n\u2022 Background in building or scaling developer tools or automation systems.",
      "word_count": 24
    }
  ],
  "urls": []
}
API 1 — extract-from-jd click to toggle
{
  "final_skills": [
    {
      "is_primary": false,
      "skill_name": "LLM"
    },
    {
      "is_primary": true,
      "skill_name": "Code Review"
    },
    {
      "is_primary": true,
      "skill_name": "Git"
    },
    {
      "is_primary": false,
      "skill_name": "Software Design"
    },
    {
      "is_primary": false,
      "skill_name": "Coding Best Practices"
    },
    {
      "is_primary": false,
      "skill_name": "Developer Tools"
    },
    {
      "is_primary": false,
      "skill_name": "Automation Systems"
    }
  ],
  "jd_role": {
    "display_name": "AI Evaluation Contractor",
    "rationale": null,
    "role_aliases": [
      "AI Evaluator",
      "Contractor for AI Evaluation"
    ],
    "role_archetype": "Engineering",
    "slug": ""
  },
  "nano_parsed": {
    "JD_type": "pass",
    "about_company": {
      "source_marker": {
        "first_5_words": "Turing is one of the",
        "last_5_words": "and frontier AI."
      },
      "text": "Turing is one of the world\u2019s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You\u2019ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.",
      "word_count": 64
    },
    "archetype_override_applied": true,
    "archetype_override_matched_skills": [
      "open-source",
      "Snowflake",
      "code quality",
      "GitHub",
      "Code Review",
      "Datadog",
      "LLMs",
      "Evaluation",
      "scaling",
      "Role",
      "Edge",
      "Models",
      "Repositories",
      "roles",
      "Task",
      "debugging"
    ],
    "certifications": [],
    "company_name": "Turing",
    "ctc": {
      "currency": "USD",
      "max": 100,
      "min": 40,
      "period": "hourly",
      "raw": "$40\u2013$100/hour"
    },
    "domain": {
      "primary": {
        "aliases": [
          "SaaS",
          "Software Development"
        ],
        "domain": "Software \u0026 SaaS Products"
      },
      "secondary": null
    },
    "education": [],
    "experience": {
      "max": null,
      "min": 7,
      "raw": "7+ years of overall professional software engineering experience"
    },
    "job_locations": [],
    "role": "AI Evaluation Contractor",
    "role_aliases": [
      "AI Evaluator",
      "Contractor for AI Evaluation"
    ],
    "role_archetype": "Engineering",
    "roles_and_responsibilities": [
      {
        "bullet_count": 5,
        "heading": "What does day-to-day look like",
        "heading_was_present": true,
        "source_marker": {
          "first_5_words": "\u2022 Review and compare 3\u20134",
          "last_5_words": "and ambiguities in model behavior."
        },
        "text": "\u2022 Review and compare 3\u20134 model-generated code responses for each task using a structured ranking system.\n\u2022 Evaluate code diffs for correctness, code quality, style, and efficiency.\n\u2022 Provide clear, detailed rationales explaining the reasoning behind each ranking decision.\n\u2022 Maintain high consistency and objectivity across evaluations.\n\u2022 Collaborate with the team to identify edge cases and ambiguities in model behavior.",
        "word_count": 56
      },
      {
        "bullet_count": 6,
        "heading": "Required Skills",
        "heading_was_present": true,
        "source_marker": {
          "first_5_words": "\u2022 At least 3 years of",
          "last_5_words": "or evaluation work is a plus."
        },
        "text": "\u2022 At least 3 years of experience at top-tier product or research companies (e.g., Stripe, Datadog, Snowflake, Dropbox, Canva, Shopify, Intuit, PayPal, or research roles at IBM, GE, Honeywell, Schneider, etc.), with a total of 7+ years of overall professional software engineering experience.\n\u2022 Strong fundamentals in software design, coding best practices, and debugging.\n\u2022 Excellent ability to assess code quality, correctness, and maintainability.\n\u2022 Proficient with code review processes and reading diffs in real-world repositories.\n\u2022 Exceptional written communication skills to articulate evaluation rationale clearly.\n\u2022 Prior experience with LLM-generated code or evaluation work is a plus.",
        "word_count": 104
      },
      {
        "bullet_count": 2,
        "heading": "Bonus Points",
        "heading_was_present": true,
        "source_marker": {
          "first_5_words": "\u2022 Experience in LLM research,",
          "last_5_words": "or scaling developer tools or"
        },
        "text": "\u2022 Experience in LLM research, developer agents, or AI evaluation projects.\n\u2022 Background in building or scaling developer tools or automation systems.",
        "word_count": 24
      }
    ],
    "urls": []
  },
  "rejected": false,
  "rejection_reason": null,
  "run_id": "3412d728-0676-44d7-a53e-9fcec73e8f1f",
  "stage3_signals": {
    "alias_found": false,
    "alias_match_roles": [],
    "kra_match_roles": [
      {
        "display_name": "React Native Developer",
        "kra_matches": [
          {
            "kra_text": "maintain code quality",
            "sentence": "Excellent ability to assess code quality, correctness, and maintainability.",
            "similarity": 0.6781
          },
          {
            "kra_text": "maintain code quality",
            "sentence": "Evaluate code diffs for correctness, code quality, style, and efficiency.",
            "similarity": 0.6272
          },
          {
            "kra_text": "maintain code quality",
            "sentence": "Strong fundamentals in software design, coding best practices, and debugging.",
            "similarity": 0.4958
          }
        ],
        "matched_count": null,
        "matched_skills": null,
        "role_id": 73,
        "score": 0.6004,
        "slug": "react-native-developer",
        "total_count": null
      },
      {
        "display_name": "Go Backend Developer",
        "kra_matches": [
          {
            "kra_text": "code review and testing support",
            "sentence": "Evaluate code diffs for correctness, code quality, style, and efficiency.",
            "similarity": 0.6094
          },
          {
            "kra_text": "code review and testing support",
            "sentence": "Excellent ability to assess code quality, correctness, and maintainability.",
            "similarity": 0.5682
          },
          {
            "kra_text": "code review and testing support",
            "sentence": "Proficient with code review processes and reading diffs in real-world repositories.",
            "similarity": 0.5497
          }
        ],
        "matched_count": null,
        "matched_skills": null,
        "role_id": 81,
        "score": 0.5758,
        "slug": "go-backend-developer",
        "total_count": null
      },
      {
        "display_name": "Angular Frontend Developer",
        "kra_matches": [
          {
            "kra_text": "code review and refactoring",
            "sentence": "Evaluate code diffs for correctness, code quality, style, and efficiency.",
            "similarity": 0.6054
          },
          {
            "kra_text": "code review and refactoring",
            "sentence": "Excellent ability to assess code quality, correctness, and maintainability.",
            "similarity": 0.5269
          },
          {
            "kra_text": "code review and refactoring",
            "sentence": "Proficient with code review processes and reading diffs in real-world repositories.",
            "similarity": 0.5202
          }
        ],
        "matched_count": null,
        "matched_skills": null,
        "role_id": 90,
        "score": 0.5508,
        "slug": "angular-frontend-developer",
        "total_count": null
      },
      {
        "display_name": "Node.js Backend Developer",
        "kra_matches": [
          {
            "kra_text": "code review and refactoring",
            "sentence": "Evaluate code diffs for correctness, code quality, style, and efficiency.",
            "similarity": 0.6054
          },
          {
            "kra_text": "code review and refactoring",
            "sentence": "Excellent ability to assess code quality, correctness, and maintainability.",
            "similarity": 0.5269
          },
          {
            "kra_text": "code review and refactoring",
            "sentence": "Proficient with code review processes and reading diffs in real-world repositories.",
            "similarity": 0.5201
          }
        ],
        "matched_count": null,
        "matched_skills": null,
        "role_id": 82,
        "score": 0.5508,
        "slug": "node-backend-developer",
        "total_count": null
      },
      {
        "display_name": "Java Backend Developer",
        "kra_matches": [
          {
            "kra_text": "code refactoring and defect fixes",
            "sentence": "Evaluate code diffs for correctness, code quality, style, and efficiency.",
            "similarity": 0.576
          },
          {
            "kra_text": "code refactoring and defect fixes",
            "sentence": "Excellent ability to assess code quality, correctness, and maintainability.",
            "similarity": 0.5357
          },
          {
            "kra_text": "code refactoring and defect fixes",
            "sentence": "Proficient with code review processes and reading diffs in real-world repositories.",
            "similarity": 0.4828
          }
        ],
        "matched_count": null,
        "matched_skills": null,
        "role_id": 79,
        "score": 0.5315,
        "slug": "java-backend-developer",
        "total_count": null
      }
    ],
    "skill_match_roles": []
  },
  "stage4_decision": {
    "alias_collision_detected": false,
    "case": "B",
    "chosen_role": {
      "display_name": "Hybrid Mobile Developer",
      "kra_matches": null,
      "matched_count": null,
      "matched_skills": null,
      "role_id": 11,
      "score": 0.6004,
      "slug": "hybrid-mobile-developer",
      "total_count": null
    },
    "confidence": 0.6004,
    "is_new_role": false,
    "llm2_fired": false,
    "llm2_reasoning": null,
    "matched_dimensions": [],
    "matched_kras": [],
    "matched_skills": [],
    "new_role_display_name": null,
    "new_role_slug": null,
    "queued": false,
    "reasoning": "KRA-led classification on react-native-developer (skill weak, KRA 0.60)",
    "sub_role": {
      "confidence": 0.6004,
      "display_name": "React Native Developer",
      "reasoning": "hoisted from chosen leaf (case=B)",
      "role_id": 73,
      "slug": "react-native-developer"
    }
  },
  "stage5_updates": {
    "centroid_n_after": 84,
    "centroid_updated": true,
    "collision_log_id": null,
    "new_kra_attached": {
      "best_kra_similarity": 0.0,
      "queue_id": 1990,
      "r_and_r_preview": "\u2022 Review and compare 3\u20134 model-generated code responses for each task using a structured ranking system.\n\u2022 Evaluate code diffs for correctness, code quality, style, and efficiency.\n\u2022 Provide clear, de",
      "role_display_name": "Hybrid Mobile Developer",
      "role_slug": "hybrid-mobile-developer",
      "status": "pending"
    },
    "new_skills_attached": [
      {
        "is_primary": false,
        "queue_id": 25471,
        "role_display_name": "Hybrid Mobile Developer",
        "role_slug": "hybrid-mobile-developer",
        "skill_name": "LLM",
        "status": "pending"
      },
      {
        "is_primary": false,
        "queue_id": 25472,
        "role_display_name": "Hybrid Mobile Developer",
        "role_slug": "hybrid-mobile-developer",
        "skill_name": "Software Design",
        "status": "pending"
      },
      {
        "is_primary": false,
        "queue_id": 25473,
        "role_display_name": "Hybrid Mobile Developer",
        "role_slug": "hybrid-mobile-developer",
        "skill_name": "Coding Best Practices",
        "status": "pending"
      },
      {
        "is_primary": false,
        "queue_id": 25474,
        "role_display_name": "Hybrid Mobile Developer",
        "role_slug": "hybrid-mobile-developer",
        "skill_name": "Developer Tools",
        "status": "pending"
      },
      {
        "is_primary": false,
        "queue_id": 25475,
        "role_display_name": "Hybrid Mobile Developer",
        "role_slug": "hybrid-mobile-developer",
        "skill_name": "Automation Systems",
        "status": "pending"
      }
    ],
    "queue_entry_id": null,
    "v3_pipeline_triggered": false,
    "v3_role_slug": null,
    "v3_run_id": null
  }
}
API 2 — extract-details
{
  "alias_matches": [
    {
      "alias_persist_skipped_reason": "TODO: REMOVE AFTER TESTING \u2014 alias DB write disabled",
      "alias_persisted": false,
      "existing_alias_id": 1829,
      "existing_alias_text": "LLMs",
      "input_term": "LLM",
      "matched_canonical": {
        "category_id": 2,
        "display_name": "LLMs",
        "id": 1193,
        "is_also_category": false,
        "is_extractable": true,
        "skill_nature": "CONCEPT",
        "slug": "llms",
        "sub_category_id": 903,
        "typical_lifespan": "EVERGREEN",
        "volatility": "EMERGING"
      },
      "matched_via": "embedding_alias"
    },
    {
      "alias_persist_skipped_reason": "alias_text already exists for this canonical skill",
      "alias_persisted": false,
      "existing_alias_id": 864,
      "existing_alias_text": "Code Review",
      "input_term": "Code Review",
      "matched_canonical": {
        "category_id": 58,
        "display_name": "Code Review",
        "id": 516,
        "is_also_category": false,
        "is_extractable": true,
        "skill_nature": "PRACTICE",
        "slug": "code-review",
        "sub_category_id": 364,
        "typical_lifespan": "EVERGREEN",
        "volatility": "STABLE"
      },
      "matched_via": "alias"
    },
    {
      "alias_persist_skipped_reason": "alias_text already exists for this canonical skill",
      "alias_persisted": false,
      "existing_alias_id": 1613,
      "existing_alias_text": "Git",
      "input_term": "Git",
      "matched_canonical": {
        "category_id": 13,
        "display_name": "Git",
        "id": 1002,
        "is_also_category": false,
        "is_extractable": true,
        "skill_nature": "TOOL",
        "slug": "git",
        "sub_category_id": 730,
        "typical_lifespan": "EVERGREEN",
        "volatility": "STABLE"
      },
      "matched_via": "alias"
    }
  ],
  "candidate_roles": [],
  "chosen_role": {
    "display_name": "Hybrid Mobile Developer",
    "id": 11,
    "rationale": "KRA-led classification on react-native-developer (skill weak, KRA 0.60)",
    "role_archetype": null,
    "slug": "hybrid-mobile-developer",
    "source": "db"
  },
  "dimensions": [
    {
      "dimension": {
        "difficulty_hint": "well_known",
        "display_name": "React Frontend Development",
        "id": 96,
        "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
        "slug": "d_init_01",
        "source": "db"
      },
      "input_skill": "LLM",
      "llm_role": null,
      "roles_from_db": []
    },
    {
      "dimension": {
        "difficulty_hint": "well_known",
        "display_name": "React Frontend Development",
        "id": 96,
        "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
        "slug": "d_init_01",
        "source": "db"
      },
      "input_skill": "Code Review",
      "llm_role": null,
      "roles_from_db": []
    },
    {
      "dimension": {
        "difficulty_hint": "well_known",
        "display_name": "React Frontend Development",
        "id": 96,
        "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
        "slug": "d_init_01",
        "source": "db"
      },
      "input_skill": "Git",
      "llm_role": null,
      "roles_from_db": []
    }
  ],
  "input_final_skills": [
    "LLM",
    "Code Review",
    "Git",
    "Software Design",
    "Coding Best Practices",
    "Developer Tools",
    "Automation Systems"
  ],
  "input_llm_skills": [
    "LLM",
    "Code Review",
    "Git",
    "Software Design",
    "Coding Best Practices",
    "Developer Tools",
    "Automation Systems"
  ],
  "new_aliases_persisted": 0,
  "run_id": "3412d728-0676-44d7-a53e-9fcec73e8f1f",
  "skills_detail": [
    {
      "aliases_in_db": [
        {
          "alias_text": "LLMs",
          "alias_type": "CANONICAL",
          "id": 1829,
          "is_primary": false,
          "match_strategy": "CASE_INSENSITIVE"
        }
      ],
      "canonical": {
        "category_id": 2,
        "display_name": "LLMs",
        "id": 1193,
        "is_also_category": false,
        "is_extractable": true,
        "skill_nature": "CONCEPT",
        "slug": "llms",
        "sub_category_id": 903,
        "typical_lifespan": "EVERGREEN",
        "volatility": "EMERGING"
      },
      "dimensions": [
        {
          "dimension": {
            "difficulty_hint": "well_known",
            "display_name": "React Frontend Development",
            "id": 96,
            "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
            "slug": "d_init_01",
            "source": "db"
          },
          "input_skill": "LLM",
          "llm_role": null,
          "roles_from_db": []
        }
      ],
      "input_skill": "LLM",
      "matched_via": "embedding_alias",
      "new_alias_persisted": false,
      "new_alias_text": null,
      "new_skill_meta": null,
      "source_tag": "db",
      "was_in_llm_skills": true
    },
    {
      "aliases_in_db": [
        {
          "alias_text": "Code Review",
          "alias_type": "CANONICAL",
          "id": 864,
          "is_primary": false,
          "match_strategy": "CASE_INSENSITIVE"
        }
      ],
      "canonical": {
        "category_id": 58,
        "display_name": "Code Review",
        "id": 516,
        "is_also_category": false,
        "is_extractable": true,
        "skill_nature": "PRACTICE",
        "slug": "code-review",
        "sub_category_id": 364,
        "typical_lifespan": "EVERGREEN",
        "volatility": "STABLE"
      },
      "dimensions": [
        {
          "dimension": {
            "difficulty_hint": "well_known",
            "display_name": "React Frontend Development",
            "id": 96,
            "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
            "slug": "d_init_01",
            "source": "db"
          },
          "input_skill": "Code Review",
          "llm_role": null,
          "roles_from_db": []
        }
      ],
      "input_skill": "Code Review",
      "matched_via": "alias",
      "new_alias_persisted": false,
      "new_alias_text": null,
      "new_skill_meta": null,
      "source_tag": "db",
      "was_in_llm_skills": true
    },
    {
      "aliases_in_db": [
        {
          "alias_text": "Git",
          "alias_type": "CANONICAL",
          "id": 1613,
          "is_primary": false,
          "match_strategy": "CASE_INSENSITIVE"
        }
      ],
      "canonical": {
        "category_id": 13,
        "display_name": "Git",
        "id": 1002,
        "is_also_category": false,
        "is_extractable": true,
        "skill_nature": "TOOL",
        "slug": "git",
        "sub_category_id": 730,
        "typical_lifespan": "EVERGREEN",
        "volatility": "STABLE"
      },
      "dimensions": [
        {
          "dimension": {
            "difficulty_hint": "well_known",
            "display_name": "React Frontend Development",
            "id": 96,
            "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
            "slug": "d_init_01",
            "source": "db"
          },
          "input_skill": "Git",
          "llm_role": null,
          "roles_from_db": []
        }
      ],
      "input_skill": "Git",
      "matched_via": "alias",
      "new_alias_persisted": false,
      "new_alias_text": null,
      "new_skill_meta": null,
      "source_tag": "db",
      "was_in_llm_skills": true
    },
    {
      "aliases_in_db": [],
      "canonical": null,
      "dimensions": [],
      "input_skill": "Software Design",
      "matched_via": null,
      "new_alias_persisted": false,
      "new_alias_text": null,
      "new_skill_meta": {
        "derived": {
          "category": "Conceptual Frameworks",
          "skill_nature": "CONCEPT",
          "sub_category": "general",
          "typical_lifespan": "EVERGREEN",
          "version_strategy": "UNVERSIONED",
          "volatility": "STABLE"
        },
        "enrichment": null,
        "keep_log": [],
        "locked_dimensions": [],
        "merge_log": [],
        "placed": null,
        "relationships": null,
        "skill_id": "software-design",
        "split_log": [],
        "typed": null,
        "warnings": []
      },
      "source_tag": "llm",
      "was_in_llm_skills": true
    },
    {
      "aliases_in_db": [],
      "canonical": null,
      "dimensions": [],
      "input_skill": "Coding Best Practices",
      "matched_via": null,
      "new_alias_persisted": false,
      "new_alias_text": null,
      "new_skill_meta": {
        "derived": {
          "category": "Soft Skills",
          "skill_nature": "PRACTICE",
          "sub_category": "general",
          "typical_lifespan": "MULTI_YEAR",
          "version_strategy": "UNVERSIONED",
          "volatility": "MEDIUM"
        },
        "enrichment": null,
        "keep_log": [],
        "locked_dimensions": [],
        "merge_log": [],
        "placed": null,
        "relationships": null,
        "skill_id": "coding-best-practices",
        "split_log": [],
        "typed": null,
        "warnings": []
      },
      "source_tag": "llm",
      "was_in_llm_skills": true
    },
    {
      "aliases_in_db": [],
      "canonical": null,
      "dimensions": [],
      "input_skill": "Developer Tools",
      "matched_via": null,
      "new_alias_persisted": false,
      "new_alias_text": null,
      "new_skill_meta": {
        "derived": {
          "category": "DevOps Tools",
          "skill_nature": "TOOL",
          "sub_category": "general",
          "typical_lifespan": "MULTI_YEAR",
          "version_strategy": "UNVERSIONED",
          "volatility": "MEDIUM"
        },
        "enrichment": null,
        "keep_log": [],
        "locked_dimensions": [],
        "merge_log": [],
        "placed": null,
        "relationships": null,
        "skill_id": "developer-tools",
        "split_log": [],
        "typed": null,
        "warnings": []
      },
      "source_tag": "llm",
      "was_in_llm_skills": true
    },
    {
      "aliases_in_db": [],
      "canonical": null,
      "dimensions": [],
      "input_skill": "Automation Systems",
      "matched_via": null,
      "new_alias_persisted": false,
      "new_alias_text": null,
      "new_skill_meta": {
        "derived": {
          "category": "Infrastructure Tools",
          "skill_nature": "PLATFORM",
          "sub_category": "general",
          "typical_lifespan": "MULTI_YEAR",
          "version_strategy": "UNVERSIONED",
          "volatility": "MEDIUM"
        },
        "enrichment": null,
        "keep_log": [],
        "locked_dimensions": [],
        "merge_log": [],
        "placed": null,
        "relationships": null,
        "skill_id": "automation-systems",
        "split_log": [],
        "typed": null,
        "warnings": []
      },
      "source_tag": "llm",
      "was_in_llm_skills": true
    }
  ],
  "unmatched_skills": [
    "Software Design",
    "Coding Best Practices",
    "Developer Tools",
    "Automation Systems"
  ]
}
API 3 — final-role-output
{
  "chosen_role": {
    "display_name": "Hybrid Mobile Developer",
    "id": 11,
    "rationale": "KRA-led classification on react-native-developer (skill weak, KRA 0.60)",
    "role_archetype": null,
    "slug": "hybrid-mobile-developer",
    "source": "db"
  },
  "chosen_role_resolution": "in_db",
  "final_input_skills": [
    {
      "skill": "LLM",
      "tag": "in_db"
    },
    {
      "skill": "Code Review",
      "tag": "in_db"
    },
    {
      "skill": "Git",
      "tag": "in_db"
    },
    {
      "skill": "Software Design",
      "tag": "new"
    },
    {
      "skill": "Coding Best Practices",
      "tag": "new"
    },
    {
      "skill": "Developer Tools",
      "tag": "new"
    },
    {
      "skill": "Automation Systems",
      "tag": "new"
    }
  ],
  "llm_cost_api1_usd": null,
  "llm_cost_api2_usd": null,
  "llm_cost_api3_usd": null,
  "llm_cost_total_usd": null,
  "persistence": {
    "items": [
      {
        "chosen_role_id": 11,
        "dimension": {
          "difficulty_hint": "well_known",
          "display_name": "React Frontend Development",
          "id": 96,
          "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
          "slug": "d_init_01",
          "source": "db"
        },
        "dimension_id": 96,
        "input_skill": "LLM",
        "llm_role": null,
        "matched_chosen_role": false,
        "outcome_line": "Skipped \u2014 no persistable v3 meta for new skill",
        "role_dimension_saved": false,
        "roles_from_db": [],
        "skill_dimension_saved": false,
        "skill_id": null,
        "skill_tag": "new",
        "skipped_reason": "skill_not_in_db_v3_proposed"
      },
      {
        "chosen_role_id": 11,
        "dimension": {
          "difficulty_hint": "well_known",
          "display_name": "React Frontend Development",
          "id": 96,
          "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
          "slug": "d_init_01",
          "source": "db"
        },
        "dimension_id": 96,
        "input_skill": "Code Review",
        "llm_role": null,
        "matched_chosen_role": false,
        "outcome_line": "Existing dimension (library) \u00b7 Role\u2194dimension skipped (dimension not under chosen role)",
        "role_dimension_saved": false,
        "roles_from_db": [],
        "skill_dimension_saved": true,
        "skill_id": 516,
        "skill_tag": "in_db",
        "skipped_reason": null
      },
      {
        "chosen_role_id": 11,
        "dimension": {
          "difficulty_hint": "well_known",
          "display_name": "React Frontend Development",
          "id": 96,
          "rationale": "Building interactive web user interfaces with React.js, including component composition, state management, hooks, and rendering patterns. React.js belongs here because it is a core library for client-side UI development in modern web applications.",
          "slug": "d_init_01",
          "source": "db"
        },
        "dimension_id": 96,
        "input_skill": "Git",
        "llm_role": null,
        "matched_chosen_role": false,
        "outcome_line": "Existing dimension (library) \u00b7 Role\u2194dimension skipped (dimension not under chosen role)",
        "role_dimension_saved": false,
        "roles_from_db": [],
        "skill_dimension_saved": true,
        "skill_id": 1002,
        "skill_tag": "in_db",
        "skipped_reason": null
      }
    ],
    "new_skills_created": 0,
    "role_dimension_saved": 0,
    "skill_dimension_saved": 0,
    "skipped": 1
  },
  "planner_output": null,
  "run_id": "3412d728-0676-44d7-a53e-9fcec73e8f1f"
}