Catch Alpha: Testing the Evaluator Before Testing the Trading Strategy

Joris Viaud

Abstract

A trading result is only as trustworthy as its evaluation. We first test our procedure on synthetic data with known truth. In this design, 0/200 zero-edge strategies pass, while detection rises with the planted edge; these finite tests do not cover every market. We then audit learning in a controlled market. Starting every policy flat, behavior cloning and implicit Q-learning recover 90% and 73% of a risk-adjusted analytic reference without costs. With quadratic costs, all ten fits for both methods lose money; median turnover is 6.03 × for cloning and 11.97 × for implicit Q-learning relative to the reference. Conservative Q-learning fails the no-cost prerequisite, so its costly result is not adjudicated. On twelve liquid cryptocurrency futures, neither the tested long-loser/short-winner reversal nor funding-carry implementations produce reliable net profit. The contribution is a reproducible workflow that measures power, counts attempts, and limits final-period access. Code: https://github.com/JorisViaudQuantAI/Catch-Alpha.

Source: semanticscholar · PDF

Read the AI summary and key takeaways for traders on WOBR Quant Research.


Open the interactive page on WOBR AI → · WOBR.AI home