Plasmonic nanoparticle-based photothermal cancer therapy is a promising new tool to inflict localized and irreversible damage to tumor tissue by hyperthermia, without harming surrounding healthy tissue. We developed a single particle and positron emission tomography (PET)-based platform to quantitatively correlate the heat generation of plasmonic nanoparticles with their potential as cancer killing agents. In vitro, the heat generation and absorption cross-section of single irradiated nanoparticles were quantified using a temperature sensitive lipid-based assay and compared to their theoretically predicted photo-absorption. In vivo, the heat generation of irradiated nanoparticles was evaluated in human tumor xenografts in mice using 2-deoxy-2-[F-18]fluoro-D-glucose ((18)F-FDG) PET imaging. To validate the use of this platform, we quantified the photothermal efficiency of near infrared resonant silica-gold nanoshells (AuNSs) and benchmarked this against the heating of colloidal spherical, solid gold nanoparticles (AuNPs). As expected, both in vitro and in vivo the heat generation of the resonant AuNSs performed superior compared to the non-resonant AuNPs. Furthermore, the results showed that PET imaging could be reliably used to monitor early treatment response of photothermal treatment. This multidisciplinary approach provides a much needed platform to benchmark the emerging plethora of novel plasmonic nanoparticles for their potential for photothermal cancer therapy.