Software, benchmarks & interface standards

17 open problems

The package landscape, the gaps between packages, and the absence of a trusted comparative benchmark.

ID Problem Priority Verdict Maturity prank
SFW-01 No package unifies PAIC, transport, estimands and reporting Very high Confirmed open Emerging 1
SFW-02 No machine-readable specification standard for ITC analyses Very high Confirmed open Emerging 1
SFW-03 No minimum validation standard for ITC and PAIC packages Very high Partially addressed Emerging 1
SFW-04 No neutral cross-package benchmark suite for PAIC implementations Very high Partially addressed Emerging 1
SFW-05 No coherent QBA software object for population-adjusted comparison Very high Confirmed open Emerging 1
SFW-07 multinma lacks partial IPD, missing data and a data-informed bridge Very high Overstated Established 1
SFW-10 maicplus variance, trimming and estimand disclosure gaps Very high Partially addressed Established 1
SFW-06 ML-NMR runtime can constrain repeated sensitivity analyses at scale High Unverifiable Established 2
SFW-08 No agreed leave-one-out unit for mixed IPD and aggregate likelihoods High Partially addressed Established 2
SFW-09 maicplus supports only binary and time-to-event endpoints High Confirmed open Established 2
SFW-12 outstandR is pairwise only with no network or disconnected validation High Confirmed open Promising 2
SFW-13 cpaic and mlumr are unreleased and independently unvalidated High Partially addressed Emerging 2
SFW-14 drMAIC has no methods paper and no independent evaluation High Confirmed open Emerging 2
SFW-17 No end-to-end error propagation study for automated synthesis pipelines High Confirmed open Emerging 2
SFW-15 netmeta and gemtc carry no target-population representation Medium-high Confirmed open Established 3
SFW-16 MBNMAdose and crossnma bridges are unidentified across a disconnection Medium-high Overstated Established 3
SFW-11 Archived MAIC packages leave no maintained CRAN installation path Medium Overstated Established 4
No matching items

Back to the full catalog