Experimentally synthesizing predicted materials in a reproducible manner remains a key bottleneck in materials science progress. Autonomous synthesis and closed loop integration of prediction and characterization can address these issues, however, this requires autonomous characterization methods for all analysis including crystallographic phase identification which currently remains a rate-limiting step. Here we demonstrate initial results in applying a collection of Artificial Intelligence (AI)-based X-Ray Diffraction (XRD) analysis methods at scale, using a workflow running across various compute platforms from High Performance Computing (HPC) to off-premise cloud. We detail the workflow methods, compare model performance on synthetic and experimental data across a wide-array of material systems, and analyze the performance of the AI methods in comparison to manually labeled experimental data.