Multiphoton calcium imaging is commonly used to monitor the spiking of large populations of neurons. Recovering action potentials from fluorescence necessitates calibration experiments, often with simultaneous imaging and cell-attached recording. Here we performed calibration for imaging conditions matching those of the Allen Brain Observatory. We developed a novel crowd-sourced, algorithmic approach to quality control. Our final data set was 50 recordings from 35 neurons in 3 mouse lines. Our calibration indicated that 3 or more spikes were required to produce consistent changes in fluorescence. Moreover, neither a simple linear model nor a more complex biophysical model accurately predicted fluorescence for small numbers of spikes (1-3). We observed increases in fluorescence corresponding to prolonged depolarizations, particularly in Emx1-IRES-Cre mouse line crosses. Our results indicate that deriving spike times from fluorescence measurements may be an intractable problem in some mouse lines.