Manuel Cebrian

Manuel Cebrian

Auto-generated profile, based on publicly available information

Manuel Cebrian

Center for Automation and Robotics (CAR), Spanish National Research Council (CSIC-UPM), Madrid, Spain

Research Focus & Metrics

Academic Career Length

20Years (2007-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 April 2026 in Nature
Verified
Journal Article
Open access
PDF file
LZLexin Zhou
Lexin Zhou
LPLorenzo Pacchiardi
Lorenzo Pacchiardi
FMFernando Martínez-Plumed
Fernando Martínez-Plumed
KCKatherine M. Collins
Katherine M. Collins
YMYael Moros-Daval
Yael Moros-Daval
Jose Hernandez-OralloJose Hernandez-Orallo
Jose Hernandez-Orallo
Ensuring safe and effective use of artificial intelligence (AI) requires understanding and anticipating its performance on new tasks, from advanced scientific challenges to transformed workplace activities 1–3 . So far, benchmarking has guided progress in AI but has offered limited explanatory and predictive power for general-purpose AI systems 4–8 , attributed to limited transferability across specific tasks 9–11 . Here we introduce general scales for AI evaluation that elicit demand profiles explaining what capabilities common AI benchmarks truly measure, extract ability profiles quantifying the general strengths and limits of AI systems and robustly predict AI performance for new task instances. Our fully automated methodology builds on 18 rubrics, capturing a broad range of cognitive and intellectual demands, which place different task instances on the same general scales, illustrated on 15 large language models (LLMs) and 63 tasks. Both the demand and the ability profiles on these scales bring new insights such as construct validity through benchmark sensitivity and specificity and explain conflicting claims about whether AI has reasoning capabilities. Ultimately, high predictive power at the instance level becomes possible using the general scales, providing superior estimates over strong black-box baseline predictors, especially in out-of-distribution settings (new tasks and benchmarks). The scales, rubrics, battery, techniques and results presented here constitute a solid foundation for a science of AI evaluation, underpinning the reliable deployment of AI in the years ahead.

6 August 2018 in Nature Human Behaviour
Verified
Journal Article
Closed access
PDF file
ARAlex Rutherford
Alex Rutherford
YLYonatan Lupu
Yonatan Lupu
MCManuel Cebrian
Manuel Cebrian
IRIyad Rahwan
Iyad Rahwan
BLBrad L. LeVeck
Brad L. LeVeck
MGManuel Garcia-Herranz
Manuel Garcia-Herranz

19 August 2022 in iScience
Verified
Journal Article
Open access
MWMarcin Waniek
Marcin Waniek
PHPetter Holme
Petter Holme
MCManuel Cebrian
Manuel Cebrian
TRTalal Rahwan
Talal Rahwan
Influencing others through social networks is fundamental to all human societies. Whether this happens through the diffusion of rumors, opinions, or viruses, identifying the diffusion source (i.e., the person that initiated it) is a problem that has attracted much research interest. Nevertheless, existing literature has ignored the possibility that the source might strategically modify the network structure (by rewiring links or introducing fake nodes) to escape detection. Here, without restricting our analysis to any particular diffusion scenario, we close this gap by evaluating two mechanisms that hide the source—one stemming from the source’s actions, the other from the network structure itself. This reveals that sources can easily escape detection, and that removing links is far more effective than introducing fake nodes. Thus, efforts should focus on exposing concealed ties rather than planted entities; such exposure would drastically improve our chances of detecting the diffusion source.

30 July 2020 in Computer
Verified
Journal Article
Closed access
NPNiccolo Pescetelli
Niccolo Pescetelli
MCManuel Cebrian
Manuel Cebrian
IRIyad Rahwan
Iyad Rahwan
We present BeeMe, an online platform designed for Internet collective action and problem solving. As a test case, we analyze data from a global performance where thousands of individuals collectively solved a mystery online. We discuss our results in light of contemporary debates on hybrid systems.

3 May 2024 in Advances in Complex Systems
Verified
Journal Article
Closed access
VSVedran Sekara
Vedran Sekara
MKMárton Karsai
Márton Karsai
EMEsteban Moro
Esteban Moro
DKDo-Hyung Kim
Do-Hyung Kim
EDEnrique Delamonica
Enrique Delamonica
MGManuel Garcia-Herranz
Manuel Garcia-Herranz