Skip to content
View melcheikh's full-sized avatar
🏠
Working from home
🏠
Working from home

Block or report melcheikh

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
melcheikh/README.md

Martín el Cheikh

I work with coding agents: I diagnose, verify on real hardware, and decide what gets sent upstream. My background is psychology (UBA) and twelve years in regulated pharmaceutical operations, so I care less about whether a number moved than about whether it measures what it says it measures.

Merged upstream

  • inspect_scout #679 (Meridian Labs). The eval_awareness example rubric counted topic vocabulary such as "test" or "scenario" as evaluation awareness. I rewrote the definition around the model's stance toward its own situation and measured it against human labels and 400 real transcripts. With Gemini 3.1 Pro as judge, false flags on topical replies went from 32 of 200 to 0 with detection unchanged. Merged October 2026, closing issue #356.
  • inspect_ai #5462 (UK AISI). Quoted comma-separated values passed through were split into lists and corrupted environment variables. Merged September 2026.
  • inspect_evals #2390 (UK AISI). mind2web_sc loaded a subset of its 200 samples and reused sample ids. Merged September 2026.
  • vLLM #48956. Fall back to native sampling when FlashInfer cannot target the GPU, found running on a consumer Blackwell card. Merged September 2026.
  • supabase/auth #2802. Exclude OAuth client sessions from MFA step-up invalidation (#2801). Merged November 2026.
  • Cap #2511, omi #20744 and local-ai-registry #293: a tray stop fallback, a 409 handled on knowledge graph rebuild, and a validated RTX 5090 Laptop entry with four measured recipes.

In review & approved

  • inspect_evals: judges whose parsing or failure handling biases the reported score.
    • #2286 sciknoweval turns grader failures into fabricated grades (Approved by MattFisher).
    • #2283 sycophancy reads any "y" in the judge's prose as a verdict.
    • #2396 makemesay judge verdict parsing.
    • #2438 agentharm refusal judge errors scored as results.
    • #2471 agent_threat_bench false security failures.
  • Elsewhere:
  • Research issue: inspect_petri #174 shows that the auditor's stance changes how often clean models confess to hidden behavior.

Models & Verification

  • Hugging Face: NVFP4 quantizations of Gemma 4 31B for Blackwell on Hugging Face, with more than 756,000 downloads as counted by the Hub.
  • YC Paxel: Audit Report analyzing 439 engineering sessions across 14 repositories, certifying deep focus, high-velocity coding with agents, and rigorous testing discipline.

Background

Psychology at UBA, in progress. Twelve years at Roemmers in pharmaceutical logistics and operations under GMP. Buenos Aires.

Pinned Loading

  1. inspect_evals inspect_evals Public

    Forked from UKGovernmentBEIS/inspect_evals

    Collection of evals for Inspect AI

    Python

  2. vllm vllm Public

    Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python

  3. AudioLegion AudioLegion Public

    Linux 4.0 Audio & Volume Scaling Fix for Lenovo Legion Pro 7i Gen 10 (16IAX10H / AW88399)

    Shell 1

  4. Flux2 Flux2 Public

    Python 1

  5. vulkan-pipeline-profiler vulkan-pipeline-profiler Public

    Lightweight C++20 explicit Vulkan pipeline timing layer, zero-dependency Python Steam Fossilize (.foz) v6 CRC32 inspector, and Linux hybrid CPU (P/E-core) topology auditor

    Python 1 1