Canli Validation
OnlineDeflated Sharpe and PBO checks. A verdict is not admission to anything and is not a forecast.
What it can do: 18 tools
validate_deflated_sharpeDeflated Sharpe ratio: the probability (0 to 1) that the selected strategy's Sharpe beats the best that luck gives across the variants tried, with the probabilistic Sharpe and that luck benchmark. Send the seven statistivalidate_overfittingProbability of backtest overfitting (0 to 1) by CSCV: how often the in-sample best variant falls below the out-of-sample median. Needs every variant's returns (periods by variants); with summary statistics only, use valivalidate_reality_checkData-snooping tests on every variant a search tried: Hansen's SPA p-value that the best beat the benchmark only by luck, White's Reality Check, and the variants Romano-Wolf StepM finds better. Send all variants tried, novalidate_paper_evidenceChecks paper-evidence.v0 structure and disclosures. With CANLI_LOCAL=1, record_file reads an export bundle and journal_file verifies signatures, source hashes and recomputed claims. Without a journal, source facts and sivalidate_breadthBook Sharpe ceiling from adding sleeves of this quality and correlation, the Sharpe at a sleeve count, and the sleeves a target needs. For portfolio construction; it validates no single strategy. This verdict is about thvalidate_track_recordMinimum track record length (observations and years) for an observed Sharpe to beat a benchmark at a confidence level; with observations, the record's probabilistic Sharpe so far. For live or paper records; to size a bacvalidate_backtest_lengthMinimum backtest length (years) before the best of N independent trials is not expected to reach a target Sharpe by luck; with backtest_years, the most trials those years allow. For planning a search; once it has a resulvalidate_haircut_sharpeHaircut Sharpe for multiple testing (Harvey and Liu 2015): the Sharpe a single test would have needed, by Bonferroni and independent tests, and with the other tests' Sharpes, Holm and BHY. For the probability the Sharpevalidate_luck_trialsHow many skill-less strategies a search would need for its best to reach this Sharpe by luck (Monte Carlo), and with a trial count, the chance it did. States luck as the best of N random tries; for the probability the Shaudit_backtestOne-call audit of a strategy's returns. Headline: one test whose false-positive rate was measured on nine return shapes (White's Reality Check with variants, luck trials with Lo's correction without). Then deflated Sharpverify_receiptread-onlyVerify a receipt offline: its Ed25519 signature against the bundled canlicapital.com key, its output hash and its id. Send an id to fetch it first, or the receipt itself. The receipt is content-hashed, reproducible fromservice_statusread-onlyWhether the validation API is up, with its quotas; check after a timeout before resubmitting. No key. This verdict is about the series exactly as submitted. The service never saw the data source, its costs, survivorship,backtest_strategyread-onlyBacktest a rule on your prices over a whole parameter grid, then validate the best with the count of variants actually run: deflated Sharpe, overfitting probability, minimum track record, vs buy and hold, after costs. Asummarize_seriesread-onlyA long price or return series in about 100 words plus fields: growth, risk, dated drawdowns, trend, volatility regime, tails, jumps, stale data. Use instead of reading raw bars. Nothing here is a forecast or advice.stress_testread-onlyStress a strategy's returns: bootstrap histories (how often the drawdown limit breaks or Sharpe turns negative) and named crash, volatility, repeat and stuck-position scenarios, with a fragility share. Frequencies over rcheck_feasibilityread-onlyCheck a trading plan before it trades: broker order-rate and minimum-order limits, 2026 US day-trading rules, square-root market impact with crowding, and the capital where costs eat the return. Checks the plan as descricheck_leakageread-onlyDoes a signal look ahead? plan gives cuts; rerun your code on the first cut rows for each, then compare. Rows that changed used later rows; the result names the pattern and horizon. No code is sent. A pass covers only thplacebo_testDoes your pipeline find edges in noise? plan writes placebo files (your data's returns in random orders, so nothing is predictable); run the whole pipeline on real.csv and on each, then compare for a p-value that counts
Connect it
claude mcp add --transport http canli-validation https://canlicapital.com/mcpSettings → Connectors → Add custom connector
URL: https://canlicapital.com/mcp{
"mcpServers": {
"canli-validation": {
"url": "https://canlicapital.com/mcp"
}
}
}{
"servers": {
"canli-validation": {
"type": "http",
"url": "https://canlicapital.com/mcp"
}
}
}Questions
What does Canli Validation do?
Deflated Sharpe and PBO checks. A verdict is not admission to anything and is not a forecast. It exposes 18 tools to AI assistants.
What tools does Canli Validation provide?
18 tools, including validate_deflated_sharpe, validate_overfitting, validate_reality_check, validate_paper_evidence, validate_breadth, validate_track_record, validate_backtest_length, validate_haircut_sharpe, validate_luck_trials, audit_backtest, verify_receipt, service_status….
How do I connect Canli Validation to Claude, ChatGPT or Cursor?
Add the remote MCP endpoint https://canlicapital.com/mcp as a custom connector or MCP server. Copy-paste setup is on this page.
Does Canli Validation require an account or API key?
No sign-in was needed to list its tools. Individual tools may still need an account or API key.
Is Canli Validation online?
As of 2026-11-19 our probe found it online. It answered 100% of our last 3 checks.
Who publishes Canli Validation?
@arhancanli on GitHub. The official MCP Registry verified that the publisher controls this GitHub account before accepting the listing.
Similar in Research & Knowledge
-
PithOnlineOfficial
Reviews of arXiv papers for AI agents: verdicts, claims, flaws, compiled records, citation graphs.
-
GovGazetteOnlineOfficialNew
Find federal contracting opportunities, research awards and vendors, and review exclusion evidence.
-
Yamagishi Lab: math-physics papers and separatorsOnlineOfficialNew
Search 1,094 math-physics preprints (JA/EN, CC BY 4.0); prompts for separators and pi-factor roots.
-
ICOS carbon and greenhouse-gas observationsOnlineOfficialNew
ICOS atmosphere, ocean and ecosystem greenhouse-gas observations, with citation and DOI per answer
-
NobleBlocksOnlineOfficial
Search 340M+ academic papers — citation graphs, semantic similarity, and AI literature reviews.
-
Grandranker Free AI SEO ToolsOnlineOfficialNew
Free, no signup: AI crawler check, llms.txt validator, ChatGPT/Perplexity/Gemini citation check.