Petrie, R., Denvil, S., Ames, S., Levavasseur, G., Fiore, S., Allen, C., Antonio, F., Berger, K., Bretonnière, P.-A., Cinquini, L., Dart, E., Dwarakanath, P., Druken, K., Evans, B., Franchistéguy, L., Gardoll, S., Gerbier, E., Greenslade, M., Hassell, D., Iwi, A., Juckes, M., Kindermann, S., Lacinski, L., Mirto, M., Nasser, A. B., Nassisi, P., Nienhouse, E., Nikonov, S., Nuzzo, A., Richards, C., Ridzwan, S., Rixen, M., Serradell, K., Snow, K., Stephens, A., Stockhause, M., Vahlenkamp, H., and Wagner, R.: Coordinating an operational data distribution network for CMIP6 data, Geosci. Model Dev., 14, 629–644, https://doi.org/10.5194/gmd-14-629-2021, 2021.
Charles Doutriaux; Thomas Maxwell; Aashish Chaudhary; Paul J. Durack; Sankhesh Jhaveri; David Lonie; Sam Fries; Dan Lipsa; Chris Harris; David E DeMarle; Remi Rampin; Denis Nadeau; Charles Doutriaux; James McEnerney; Jonathan Beezley; Harinarayan Krishnan; Jeffrey Painter; Brad King; Ben Burnett; Andrew Bauer; Huy T. Vo; Dean N. Williams; Zach Mullen; Bryce Sampson; Arulalan T.; Edward Brown; Boonthanome Nouanesengsy; Jonathas Costa. Ultrascale Visualization Climate Data Analysis Tools (UV-CDAT), release version 2.10.0, May 11, 2017, DOI: 10.5281/zenodo.574661.
Santer, B.D., J.C. Fyfe, G. Pallotta, G.M. Flato, G.A. Meehl, M.H. England, E. Hawkins, M.E. Mann, J.F. Painter, C. Bonfils, I. Cvijanovic, C. Mears, F.J. Wentz, S. Po-Chedley, Q. Fu, C.-Z. Zou. “Model Expectations and Reality: The Case of Tropospheric Warming.” Nature Geoscience 2017 (in review).
Adam Arkin, David Bader, Tjerk Straatsma, Jack Wells, James Hack, Richard Coffey, Eli, Dart, Matt Jacobson, Jeremy Smith, Rich Bonneau, Dan Rokhsar, Lee Ann Mccue, Tim Scheibe, Eoin Brody, Kathy Yelick, Bill Gustafson, Minghua Zhang, Gil Compo, Dave Moulton, Peter Thornton, Wieslaw Maslowski, Todd Ringler, Bill Collins, Phil Jones, Nathan Urban, Kate Calvin, Andy Jones, Dean N. Williams, Pavlos Kollias, Bert Debusschere, His-Yen Ma, Kate Evans, Esmond Ng, Rob Jacob, Pat Worley, Katie Antypas, Richard Gerber, Katherine Riley, Mary Fitzpatrick, Beth Cerny. “Biological and Environmental Research Exascale Requirements Review,” A Meeting Report from the March 28–31, 2016, Workshop (in review).
Lee, D., S.-K. Min, J. Jin, J.-W. Lee, D.-H. Cha, M.-S. Suh, J.-B. Ahn, S.-Y. Hong, H.-S. Kang, M. Joh. “Mechanisms for Future Changes in Extreme Precipitation over Northeast Asia and Korea: A Multi-RCM Study.” Climate Dynamics, March 23, 2017. DOI: 10.1007/s00382-017-3566-4.
Hashim Iqbal Chunpir, Dean N. Williams, Thomas Ludwig. “User eXperience (UX) of a Big Data Infrastructure,” The 19th International Conference on Human-Computer Interaction (HCI), Vancouver, Canada, July 9–14 2017 (accepted).
Zeshawn Shaheen, Charles Doutriaux. Community Diagnostics Package (CDP), release version 1.0.3, March 15, 2017, DOI: 10.5281/zenodo.399291.
Dean N. Williams, et al. U.S. DOE. 6th Annual Earth System Grid Federation Face-to-Face Conference Report. DOE/SC-0188. U.S. Department of Energy Office of Science.,” March 2017, https://esgf.llnl.gov/esgf-media/pdf/2017-ESGF_F2F_Conference_Report.pdf, DOI: 10.2172/1369382, https://doi.org/10.2172/1369382.
Santer, B.D., S. Solomon, G. Pallotta, C. Mears, S. Po-Chedley, Q. Fu, F.J. Wentz, C.-Z. Zou, J.F. Painter, I. Cvijanovic, C. Bonfils. “Comparing Tropospheric Warming in Climate Models and Satellite Data.” J. Clim. 2017 30, 373–392. DOI: 10.1175/JCLI-D-16-0333.1
S. Fiore, M. Płóciennik, C. Doutriaux, C. Palazzo, J. Boutte, T. Żok, D. Elia, M. Owsiak, A. D’Anca, Z. Shaheen, R. Bruno, M Fargetta, M. Caballer, G. Moltó, I. Blanquer, R. Barbera, M. David, G. Donvito, D. N. Williams, V. Anantharaj, D. Salomoni, and G. Aloisio.” “Distributed and Cloud-Based Multi-Model Analytics Experiments on Large Volumes of Climate Change Data in the Earth System Grid Federation Eco-system,” IEEE International Conference Proceedings on Big Data, Washington D.C., USA, December 5–8, 2016, https://static.aminer.org/pdf/fa/bigdata2016/S13209.pdf.
Denis Nadeau, Charles Doutriaux, Tim Bradshaw, Jamie Kettleborough, Tobias Weigel, Emma Hogan, Paul J. Durack. CMOR release version 3.2.0, November 2016, DOI: 10.5281/zenodo.168253.
Charles Doutriaux, Paul J. Durack, Peter Gleckler, Jeffrey Painter. PCMDI Metrics, release version 1.1.1, July 2016, DOI: 10.5281/zenodo.58440.
M. Plociennik, S. Fiore, G. Donvito, M. Owsiak, M. Fargetta, R. Barbera, R. Bruno, E. Giorgio, D. N. Williams, G. Aloisio. “Two-level dynamic workflow orchestration in the INDIGO DataCloud for large-scale, climate change data analytics experiments,” International Conference on Computational Science (ICCS2016), June 6–8, 2016, San Diego, California, USA, Vol. 80, pp. 722–733, http://dx.doi.org/10.1016/j.procs.2016.05.359.
D. Elia, S. Fiore, A. D’Anca, C. Palazzo, I. Foster, D. N. Williams, G. Aloisio. “An In-Memory Based Framework for Scientific Data Analytics,” ACM International Conference on Computing Frontiers (CF’ 16), May 16–19, 2016, Como, Italy, http://dl.acm.org/citation.cfm?doid=2903150.2911719.
Jim McEnerney, Sasha Ames, Cameron Christensen, Charles Doutriaux, Tony Hoang, Jeff Painter, Brian Smith, Zeshawn Shaheen, Dean Williams. “Parallelization of Diagnostics for Climate Model Development,” A Journal of Software Engineering and Applications (accepted), DOI: 10.4236/jsea.2016.95016.
Covey, C., P. J. Gleckler, C. Doutriaux, D. N. Williams, A. Dai, J. Fasullo, K. Trenberth, A. Berg. “Metrics for the Diurnal Cycle of Precipitation: Toward Routine Benchmarks for Climate Models,” Journal of Climate March 15, 2016 (this work; http://journals.ametsoc.org/doi/pdf/10.1175/JCLI-D-15-0664.1.
Dean Williams, V. Balaji, Luca Cinquini, Sébastien Denvil, Daniel Duffy, Ben Evans, Robert Ferraro, Rose Hansen, Michael Lautenschlager, Claire Trenham. “A Global Repository for Planet-Sized Experiments and Observations,” Bulletin of the American Meteorological Society, May 2016, DOI: http://dx.doi.org/10.1175/BAMS-D-15-00132.1.
Williams, D. N. “Better Tools to Build Better Climate Models.,” Cover of Eos, 97, DOI: 10.1029/2016EO045055. Published on 9 February 2016.
Dean N. Williams, Giriprakash Palanisamy, Kerstin Kleese van Dam, et al.. U.S. DOE. 2016. Working Group on Virtual Data Integration: A Report from the August 13–14, 2015, Workshop. DOE/SC-0180. U.S. Department of Energy Office of Science. Release number: LLNL-TR-678127-REV-1. DOI: 10.2172/1227017. Published February 2016.
Charles Doutriaux; Thomas Maxwell; Aashish Chaudhary; Sam Fries; Paul J. Durack; Sankhesh Jhaveri; David Lonie; Chris Harris; David E DeMarle; Dan Lipsa; Remi Rampin; Denis Nadeau; James McEnerney; Jonathan Beezley; Harinarayan Krishnan; Jeffrey Painter; Brad King; Ben Burnett; Andrew Bauer; Huy T. Vo; Dean N. Williams; Zach Mullen; Bryce Sampson; Arulalan T.; Boonthanome Nouanesengsy; Stephane Raynaud; Matthew Harris. UV-CDAT Release version 2.6, June 2016, DOI: 10.5281/zenodo.56759.
Matthew B. Harris, Sam B. Fries, Dean N. Williams, Sterling A. Baldwin, James W. Crean, Bryce J. Sampson, Edward M. Brown, Anna Paula M. Pawlicka. “The Legend of CDAT: A Link to the Past,” Proceedings of the World Congress on Engineering and Computer Science 2016 Vol I WCECS, http://www.iaeng.org/publication/WCECS2016/WCECS2016_pp181-184.pdf.
Jim McEnerney. “A Real Nullstellensatz with Multiplicity,” Journal of Pure and Applied Algebra, 2016 (accepted), http://www.journals.elsevier.com/journal-of-pure-and-applied-algebra/), DOI: 10.1016/j.jpaa.2016.12.010.
Sterling A. Baldwin, Matthew B. Harris, Samuel B. Fries. “Science as a Service,” Proceedings of The World Congress on Engineering and Computer Science , Vol. I, WCECS 2016, October 21–23, 2016, San Francisco, USA, pp. 123-–126, http://www.iaeng.org/publication/WCECS2015/ ISBN: 978-988-19253-6-7.
Chad A. Steed, Katherine J. Evans, John F. Harney, Brian C. Jewell, Galen Shipman, Brian E. Smith, Peter E. Thornton, Dean N. Williams. Web-Based Visual Analytics for Extreme Scale Climate Science, Oak Ridge National Laboratory, 2016, 10.1109/BigData.2014.7004255.
Gleckler, P. J., C. Doutriaux, P. J. Durack, K. E. Taylor, Y. Zhang, D. N. Williams, E. Mason, J. Servonnat. (“A More Powerful Reality Test for Climate Models,” Eos, 97, DOI: 10.1029/2016EO051663, 3 May 2016.
Dean N. Williams, et al. U.S. DOE. 5th Annual Earth System Grid Federation Face-to-Face Conference Report. DOE/SC-0181. U.S. Department of Energy Office of Science,” March 2016, DOI: 10.2172/1253685.
Dean N. Williams. “5th Annual Earth System Grid Federation and Observations,” LLNL Technical Report #LLNL-TR-689917, April 2016, DOI: 10.2172/1253685.
Christensen, C., S. Liu, G. Scorzelli, J.-W. Lee, P.-T. Bremer, V. Pascucci. “Embedded Domain-Specific Language and Runtime System for Progressive Spatiotemporal Data Analysis and Visualization.” The 6th IEEE Symposium on Large Data Analysis and Visualization (LDAV): Baltimore, Maryland. October 23, 2016, http://www.sci.utah.edu/publications/Chr2016a/christiensen_LDAV16.pdf.
S. Bony, C. Senior, …, D. N. Williams, et al. “Report of the Nineteenth Session of the Working Group on Coupled Modelling (WGCM) Progress Report,” WCRP Report No. 2/1016, January 2016, http://www.wcrp-climate.org/images/modelling/WGCM/WGCM19/documents/WGCM19_reportv4.pdf.
Gleckler, P.J., C. Doutriaux, P.J. Durack, K. E. Taylor, Y. Zhang, D. N. Williams, E. Mason, J. Servonnat. “A More Powerful Reality Test for Climate Models,” Eos Trans. AGU 2016, 97, DOI:10.1029/2016EO051663.
Santer, B.D., S. Solomon, G. Pallotta, C. Mears, S. Po-Chedley, Q. Fu, F.J. Wentz, C.-Z. Zou, J.F. Painter, I. Cvijanovic, C. Bonfils. “Comparing Tropospheric Warming in Climate Models and Satellite Data.” Journal of Climate, AMS, Vol. 30, No. 7, April 2017, DOI: http://dx.doi.org/10.1175/JCLI-D-16-0333.1.
Eyring, V., P. J. Gleckler, C. Heinze, R. J. Stouffer, K. E. Taylor, V. Balaji, E. Guilyardi, S. Joussaume, S. Kindermann, B. N. Lawrence, G. A. Meehl, M. Righi, and D. N. Williams. “Towards Improved and More Routine Earth System Model Evaluation in CMIP6,” Earth System Dynamics, November 2016, DOI: 10.5194/esd-7-813-2016.
Santer, B.D., S. Solomon, D.A. Ridley, J.C. Fyfe, F. Beltran, C. Bonfils, J.F. Painter, M.D. Zelinka. “Volcanic Effects on Climate.” Nature Climate Change 2016, 6, 3-4. DOI: 10.1038/nclimate2859.
John. L. Schnase, Tsengdar J. Lee, Chris A. Mattmann, Christopher S. Lynnes, Luca Cinquini, Paul M. Ramirez, Andrew F. Hart, Dean Williams, Duane Waliser, Pamela Rinsland, W. Phillip Webster, Daniel Q. Duffy, Mark A. McInerney, Glenn S. Tamkin, Gerald L. Potter, Laura Carriere. “Big Data Challenges in Climate Science: Improving the Next-Generation Cyberinfrastructure,” IEEE Geoscience and Remote Sensing Magazine, vol. 4, no. 3, pp. 10–22, Sept. 2016, DOI: 10.1109/MGRS.2015.2514192.
Dean N. Williams. “Strategic Roadmap for the Earth System Grid Federation,” IEEE International Conference on Big Data, Santa Clara, CA, USA, October 29, 2015–November 1, 2015, DOI: 10.1109/BigData.2015.7364005.
Matthew B. Harris, Samuel B. Fries, Sterling A. Baldwin, Dakotah S. M. Webb. “Nerd Herding: Practical Project Management in the Field,” Lecture Notes in Engineering and Computer Science: Proceedings of The World Congress on Engineering and Computer Science 2015, October 21–23, 2015, San Francisco, USA, pp. 123–126, http://www.iaeng.org/publication/WCECS2015/WCECS2015_pp123-126.pdf.
Céline J.W. Bonfils, Benjamin D. Santer, Thomas J. Phillips, Kate Marvel, L. Ruby Leung, Charles Doutriaux, Antonietta Capotondi. “Relative Contributions of Mean-State Shifts and ENSO-Driven Variability to Precipitation Changes in a Warming Climate,” Journal of Climate October 2015, DOI: 10.1175/JCLI-D-15-0341.1.
Peter J. Gleckler, Charles Doutriaux, Paul J. Durack, Karl E. Taylor, Yuying Zhang, Dean N. Williams, Erik Mason, Jérôme Servonnat. “A Package to Make Performance Summaries from Climate Model Intercomparisons more Accessible,” Eos, Transactions American Geophysical Union (2015).
C. Palazzo, A. Mariello, S. Fiore, A. D’Anca, D. Elia, D. N. Williams, G. Aloisio. “A Workflow-Enabled Big Data Analytics Software Stack for eScience,” The Second International Symposium on Big Data Principles, Architectures & Applications (BDAA 2015), HPCS 2015, Amsterdam, Netherlands, July 20–24, pp. 545–552.
Hashim Iqbal Chunpir, Dean N. Williams, Thomas Ludwig. “Evolution of e-Research: From Infrastructure Development to Service Orientation,” HCI International Conference (2015).
Chris A. Mattmann, Christopher S. Lynnes, Luca Cinquini, Paul M. Ramirez, Andrew F. Hart, Dean Williams, Duane Waliser1, Pamela Rinsland. “Next Generation Cyber-infrastructure to Support Comparison of Satellite Observations with Climate Models,” Conference on Big Data from Space (BIDS ’15), Research, Technology and Innovation (RT&I), Frascati, Italy (2015).
Dean N. Williams. “2014 Earth System Grid Federation and Ultrascale Visualization Climate Data Analysis Tools Conference Report,” LLNL Technical Report #LLNL-TR-666753, January 2015, http://www.osti.gov/scitech/biblio/1182238-earth-system-grid-federation-ultrascale-visualization-climate-data-analysis-tools-conference-report DOI: 10.2172/1182238.
David Moulton, Deb Agarwal, Tom Boden, Charlie Koven, Tim Scheibe, Carl Steefel, Peter Thorton, Dean Williams. “U.S. DOE. 2015. Building a Cyberinfrastructure for Environmental System Science: Modeling Frameworks, Data Management, and Scientific Workflows; Workshop Report.” DOE/SC-0178. U.S. Department of Energy Office of Science. http://doesbr.org/ESS-WorkingGroups/.
Benjamin D. Santer, Susan Solomon, Céline Bonfils, Mark D. Zelinka, Jeffrey F. Painter, Francisco Beltran, John C. Fyfe, Gardar Johannesson, Carl Mears, David A. Ridley, Jean-Paul Vernier, Frank J. Wentz. “Observed Multivariable Signals of Late 20th and Early 21st Century Volcanic Activity,” AGU Geophysical Research Letters, 42 (2) 500–509 (2015), DOI: 10.1002/2014GL062366.
Marvel, K., M. D. Zelinka, S. A. Klein, C. Bonfils, P. M. Caldwell, C. Doutriaux, B. D. Santer, K. E. Taylor. “External Influences on Modeled and Observed Cloud Trends,” J. Climate 2015, 28, 4820–4840, DOI: 10.1175/JCLI-D-14-00734.1.
Dean N. Williams. “Visualization and Analysis Tools for Ultrascale Climate Data,” Eos, Transactions American Geophysical Union 95 (42), 377–378 (2014), DOI: 10.1002/2014EO420002.
D.N. Williams, Giri Palanisamy, Galen Shipman, Thomas Boden, Jimmy Voyles. “Department of Energy Strategic Roadmap for Earth System Science Data Integration,” Big Data, 2014 IEEE International Conference Proceedings, Washington D.C., USA, pp. 772–777 (2014), DOI:10.1109/BigData.2014.7004304.
Matthew Harris, “Webengine,” Proceedings of the World Congress on Engineering and Computer Science 2014, Vol. I, WCESC 2014, San Francisco, USA, pp. 131–135, http://www.iaeng.org/publication/WCECS2014/.
Sandro Fiore, Alessandro D’Anca, Donatello Elia, Cosimo Palazzo, Dean N. Williams, Ian T. Foster, Giovanni Aloisio. “Ophidia: A Full Software Stack for Scientific Data Analytics,” IEEE High Performance Computing & Simulation (HPCS), 2014 International Conference, Bologna, Italy, pp. 343–350 (2014)10.1109/HPCSim.2014.6903706, ISBN: 978-1-4799-5311-0.
L. Cinquini, D.J. Crichton, C. Mattmann, J. Harney, G.M. Shipman, F. Wang, R. Ananthakrishnan, N. Miller, S. Denvil, M. Morgan, Z. Pobre, G.M. Bell, C.M. Doutriaux, R.S. Drach, D.N. Williams, P. Kershaw, S. Pascoe, E. Gonzalez, S. Fiore, R. Schweitzer. “The Earth System Grid Federation: An Open Infrastructure for Access to Distributed Geospatial Data,” Future Generation Computer System 36, 400–417 (2014), DOI: 10.1016/j.future.2013.07.002.
S. Fiore, A. D’Anca, D. Elia, C. Palazzo, I. Foster, D. Williams, G. Aloisio. “Ophidia: A Full Software Stack for Scientific Data Analytics,” Proc. of the 2014 International Conference on High Performance Computing & Simulation (HPCS 2014), Bologna, Italy, pp. 343–350 (2014), ISBN: 978-1-4799-5311-0.
Dean N. Williams. “3rd Annual Earth System Grid Federation and 3rd Annual Earth System Grid Federation and Ultrascale Visualization Climate Data Analysis Tools Face-to-Face Meeting Report December 2013,” LLNL Technical Report #LLNL-TR-650500, February 2014, http://www.osti.gov/scitech/biblio/1124881-annual-earth-system-grid-federation-annual-earth-system-grid-federation-ultrascale-visualization-climate-data-analysis-tools-face-face-meeting-report-december) DOI: 10.2172/1124881.
Chad A. Steed, Katherine J. Evans, John F. Harney, Brian C. Jewell, Galen Shipman, Brian E. Smith, Peter E. Thornton, Dean N. Williams. “Web-Based Visual Analytics for Extreme Scale Climate Science,” Big Data, 2014 IEEE International Conference Proceedings: pp. 383–392, Washington D.C., October 27–30, 2014, DOI:10.1109/BigData.2014.7004255.
Santer, B.D., C. Bonfils, J.F. Painter, M. Zelinka, C. Mears, S. Solomon, G.A. Schmidt, J.C. Fyfe, J.N.S. Cole, L. Nazaenko, K.E. Taylor, F.J. Wentz. “Volcanic Contribution to Decadal Changes in Tropospheric Temperature.” I 2014, 7, 185–189, DOI: 10.1038/ngeo2098.
Improving Processes for User Support in e-Science Hashim I. Chunpir, Thomas Ludwig (2014): Improving Processes for User Support in e-Science. IEEE eScience 2014 Conference - Works in Progress session
Reviewing the governance structure of end-user support in e-Science infrastructures Hashim I. Chunpir, Thomas Ludwig (2014): Reviewing the governance structure of end-user support in e-Science infrastructures. –INFORMATIK-2014 Beyond Data (2014).
A snap-shot of user support services in Earth System Grid Federation (ESGF): a use case of climate cyberinfrastructure Hashim Iqbal Chunpir, Thomas Ludwig, A. Badewi: A snap-shot of user support services in Earth System Grid Federation (ESGF): a use case of climate cyberinfrastructure. 2nd International Conference on Human Side of Service Engineering, an associate conference of 5th International Conference on Applied Human Factors and Ergonomics (AHFE), 2014
User Support System in the Complex Environment Hashim Iqbal Chunpir, Amgad Ali Badewi, Thomas Ludwig: User Support System in the Complex Environment. HCI (11) 2014: 392-402
Using Soft Systems Methodology (SSM) in Understanding Current User-Support Scenario in the Climate Science Domain of Cyber-Infrastructures Hashim Iqbal Chunpir, Thomas Ludwig, Amgad Ali Badewi: Using Soft Systems Methodology (SSM) in Understanding Current User-Support Scenario in the Climate Science Domain of Cyber-Infrastructures.HCI (10) 2014: 495-506
S. Fiore, C. Palazzo, A. D’Anca, I. T. Foster, D. N. Williams, G. Aloisio. “A Big Data Analytics Framework for Scientific Data Management,” IEEE Big Data Conference 2013: 1–8.
S. Fiore, A. D’Anca, C. Palazzo, I. T. Foster, D. N. Williams, G. Aloisio. “Ophidia: Toward Big Data Analytics for eScience,” ICCS 2013, June 5–7, 2013, Barcelona, Spain, ICCS, volume 18 of Procedia Computer Science, pp. 2376–2385. Elsevier, 2013.
G. Aloisio, S. Fiore, I. Foster, D. Williams. “Scientific Big Data Analytics Challenges at Large Scale,” Big Data and Extreme-scale Computing (BDEC), April 30 to May 01, 2013, Charleston, South Carolina, USA (position paper).
Boonthanome Nouanesengsy, John Patchett, James Ahrens, Andrew Bauer, Aashish Chaudhary, Ross Miller, Berk Geveci, Galen M. Shipman, Dean N. Williams. “A Model for Optimizing File Access Patterns using Spatio-temporal Parallelism,” ACM UltraVis ’13, Article No. 4, ACM New York, NY, USA ©2013, ISBN: 978-1-4503-2500-4 DOI>10.1145/2535571.2535593.
Dean N. Williams et al. “Earth System Grid Federation: Infrastructure to Support Climate Science Analysis as an International Collaboration.” In Data Intensive Science: Critchlow, Terence and Kleese-Van Dam, Kerstin, Editors. Boca Raton: Taylor and Francis Group, A Chapman & Hall CRC Press Book, Computational Science Series, 2013.
Dean N. Williams et al. Contributions to the GRID Chapter 7 in Earth System Modelling – Volume 6: ESM Data Archives in the Times of the Grid, Springer Berlin Heidelberg, 2013. http://www.springer.com/authors/book+authors/springerbriefs. ISBN 9783642372438.
Sandro Fiore, Alessandro D’Anca, Donatello Elia, Cosimo Palazzo, Dean N. Williams, Ian T. Foster, Giovanni Aloisio. “Ophidia: A Full Software Stack for Scientific Data Analytics,” IEEE High Performance Computing & Simulation (HPCS), 2014 International Conference, Bologna, Italy, pp. 343–350 (2014) 10.1109/HPCSim.2014.6903706, ISBN: 978-1-4799-5311-0.
Chad A. Steed, Daniel M. Ricciuto, Galen Shipman, Brian Smith, Peter E. Thornton, Dali Wang, Xiaoying Shi, Dean N. Williams. “Big Data Analytics for Earth System Simulation Exploratory Analysis,” Computers & Geosciences, Volume 61, December 2013, pp. 71–82. http://dx.doi.org/10.1016/j.cageo.2013.07.025. CAGEO 2013 Best Paper Award.
Brian Smith, Daniel M. Ricciuto, Peter E. Thornton, Galen Shipman, Chad A. Steed, Dean Williams, Michael Wehner. “ParCAT: Parallel Climate Analysis Toolkit,” Procedia Computer Science, vol. 18, 2013 International Conference on Computational Science, pp. 2367–2375, DOI http://dx.doi.org/10.1016/j.procs.2013.05.408.
Jacqueline Chen, Alok Choudhary, Stuart Feldman, Bruce Hendrickson, Chris Johnson, Richard Mount, Vivek Sarkar, Victoria White, Dean Williams. “Synergistic Challenges in Data-Intensive Science and Exascale Computing,” DOE ASCAC Data Subcommittee Report 2013, http://science.energy.gov/~/media/ascr/ascac/pdf/reports/2013/ASCAC_Data_Intensive_Computing_report_final.pdf.
Luca Cinquini, Daniel Crichton, Chris Mattmann, Gavin M. Bell, Charles Doutriaux, Bob Drach, Dean Williams, John Harney, Galen Shipman, Feiyi Wang, Philip Kershaw, Stephen Pascoe, Rachana Ananthakrishnan, Neill Miller, Estanislao Gonzalez, Sebastian Denvil, Mark Morgan, Sandro Fiore, Zed Pobre, Roland Schweitzer. “The Earth System Grid Federation: An Open Infrastructure for Access to Distributed Geospatial Data,” IEEE special issue of FGCS (Future Generation Computing Systems), 2013.
Dean Williams, Charles Doutriaux, John Patchett, Sean Williams, Galen Shipman, Ross Miller, Chad Steed, Harinarayan Krishnan, Claudio Silva, Aashish Chaudhary, Peer-Timo Bremer, David Pugmire, Wes Bethel, Hank Childs, Mr Prabhat, Berk Geveci, Andrew Bauer, Alexander Pletzer, Jorge Poco, Tommy Ellqvist, Emanuele Santos, Gerald Potter, Brian Smith, Thomas Maxwell, David Kindig, David Koop. “The Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT): Data Analysis and Visualization for Geoscience Data,” Computer, 27 March 2013. IEEE Computer Society Digital Library. http://doi.ieeecomputersociety.org/10.1109/MC.2013.119.
Dean N. Williams, Timo Bremer, Charles Doutriaux, John Patchett, Galen Shipman, Blake Haugen, Ross Miller, Brian Smith, Chad Steed, E. Wes Bethel, Hank Childs, Harinarayan Krishnan, Michael Wehner, Claudio T. Silva, Emanuele Santos, David Koop, Tommy Ellqvist, Huy T. Vo, Jorge Poco, Berk Geveci, Aashish Chaudhary, Andrew Bauer, Alexander Pletzer, Dave Kindig, Gerald L. Potter, Thomas P. Maxwell. “The Ultra-scale Visualization Climate Data Analysis Tools: Data Analysis and Visualization for Geoscience Data,” IEEE Special Issue: Cutting-Edge Research in Visualization, 2013 (cover story).
Dean N. Williams, Timo Bremer, Charles Doutriaux, John Patchett, Sean Williams, Galen Shipman, Ross Miller, David R. Pugmire, Brian Smith, Chad Steed, E. Wes Bethel, Hank Childs, Harinarayan Krishnan, Prabhat, Michael Wehner, Claudio T. Silva, Emanuele Santos, David Koop, Tommy Ellqvist, Jorge Poco, Berk Geveci, Aashish Chaudhary, Andy Bauer, Alexander Pletzer, David Kindig, Gerald L. Potter, Thomas P. Maxwell. “Ultrascale Visualization of Climate Data,” IEEE Computer Magazine, September 2013, vol. 46 no 9, pp. 68–76, http://doi.ieeecomputersociety.org/10.1109/MC.2013.119.
Emanuele Santos, Jorge Poco, Yaxing Wei, Shishi Liu, Bob Cook, Dean N. Williams, Claudio T. Silva. “UV-CDAT: Analyzing Climate Datasets from a User’s Perspective,” IEEE Visualization Corner, Computing in Science & Engineering, volume 15, Issue 1, Jan–Feb 2013. DOI: 10.1109/MCSE.2013.15.
Santer, B.D., J. Painter, C. Bonfils, C. Mears, S. Solomon, T.M.L. Wigley, P.J. Gleckler, G.A. Schmidt, C. Doutriaux, N.P. Gillett, K.E. Taylor, P.W. Thorne, F.J. Wentz. “Human and natural influences on the changing thermal structure of the atmosphere.” Proc. Nat. Acad. of Sci., released online 2013, DOI: 110/43/17235.
Santer, B.D., J.F. Painter, C.A. Mears, C. Doutriaux, P. Caldwell, J.M. Arblaster, P.J. Cameron-Smith, N.P. Gillett, P.J. Gleckler, J. Lanzante, J. Perlwitz, S. Solomon, P.A. Stott, K.E. Taylor, L. Terray, P.W. Thorne, M.F. Wehner, F.J. Wentz, T.M.L. Wigley, L.J. Wilcox, C.-Z. Zou. “Identifying human influences on atmospheric temperature.” Proceedings of the National Academy of Sciences 2013, 110, 26–33, DOI: 10.1073/pnas.1210514109.
ESGF Fact Sheet The Earth System Grid Federation (ESGF) peer-to-peer enterprise system is an interagency and international effort led by the U.S. Department of Energy, and co-funded by National Aeronautics and Space Administration, National Oceanic and Atmospheric Administration, National Science Foundation, as well as international laboratories including the Max Planck Institute for Meteorology, the German Climate Computing Centre, the Australian National University/National Computational Infrastructure, and the British Atmospheric Data Center.
ESGF R&D100 2013 The Earth System Grid Federation (ESGF, esgf.org) is an international collaboration for the software that powers most global climate change research, notably assessments by the International Panel on Climate Change. The portal below is for the Program for Climate Modeling Diagnosis and Intercomparison at Livermore, one of dozens federated around the world.
Dean N. Williams, Ian T. Foster, Don E. Middleton, Rachana Ananthakrishnan, Neill Miller, Mehmet Balman, Junmin Gu, Vijaya Natarajan, Arie Shoshani, Alex Sim, Gavin Bell, Robert Drach, Michael Ganzberger, Jim Ahrens, Phil Jones, Daniel Crichton, Luca Cinquini, David Brown, Danielle Harper, Nathan Hook, Eric Nienhouse, Gary Strand, Hannah Wilcox, Nathan Wilhelmi, Stephan Zednik, Steve Hankin, Roland Schweitzer, John Harney, Ross Miller, Galen Shipman, Feiyi Wang, Peter Fox, Patrick West, Stephan Zednik, Ann Chervenak, Craig Ward, “Earth System Grid Center for Enabling Technologies (ESG-CET): A Data Infrastructure for Data-Intensive Climate Research”, SciDAC Conference, 2011. https://digital.library.unt.edu/ark:/67531/metadc869320/, DOI: 10.2172/1113915.
Dean N. Williams, Bryan N. Lawrence, Michael Lautenschlager, Don Middleton, V. Balaji, “The Earth System Grid Federation: Delivering globally accessible petascale data for CMIP5”, Proceedings of the Asia-Pacific Advanced Network, 2011, v. 32, p. 121-130. http://dx.doi.org/10.7125/APAN.32.15, ISSN 2227-3026.
A. Sim, D. Gunter, V. Natarajan, A. Shoshani, D. Williams, J. Long, J. Hick, J. Lee, E. Dart, “Efficient Bulk Data Replication for the Earth System Grid”, Proceedings of International Symposium on Grid Computing, Data Driven e-Science: Use Cases and Successful Applications of Distributed Computing Infrastructures (ISGC 2010), 2011, pp 435-444. DOI: 10.1007/978-1-4419-8014-4_33, ISBN 978-1-4419-8014-4.
A. Sim, M. Balman, D. Williams, A. Shoshani, V. Natarajan, “Adaptive Transfer Adjustment in Efficient Bulk Data Transfer Management for Climate Datasets”, The 22nd IASTED International Conference on Parallel and Distributed Computing and System (PDCS), 2010. DOI: 10.2316/P.2010.724-062.
R. Kettimuthu, A. Sim, D. Gunter, B. Allcock, P. Bremer, J. Bresnahan, A. Cherry, L. Childers, E. Dart, I. Foster, K. Harms, J. Hick, J. Lee, M. Link, J. Long, K. Miller, V. Natarajan, V. Pascucci, K. Raffenetti, D. Ressman, D. Williams, L. Wilson, L. Winkler, “Lessons learned from moving earth system grid data sets over a 20 Gbps wide-area network”, HPDC’10, ACM, 2010, 316-319, doi:10.1145/1851476.1851519.
Lessons learned from moving Earth System Grid data sets over a 20 Gbps wide-area network In this paper, we report on obstacles overcome and the key lessons learned in moving a small portion (10 TB) of the multimodel Coupled Model Intercomparison Project, Phase 3 data set used in the IPCC Fourth Assessment Report from three sources—the Argonne Leadership Computing Facility (ALCF), Lawrence Livermore National Laboratory (LLNL), and National Energy Research Scientific Computing Center (NERSC)—to the 2009 Supercomputing conference (SC09) show floor in Portland, Oregon.
Experience Report on the Supercomputing 2009 Bandwidth Challenge from the Perspective of the Earth System Grid The Supercomputing 2009 (SC09) Bandwidth Challenge entry titled, “High Performance GridFTP Transport of Earth System Grid (ESG) Data,” demonstrated high-performance GridFTP transport of climate data from multiple Department of Energy laboratories to the targeted SC09 showroom floor. The transferred multi-terabyte data consisted of a small portion of the multi-model Coupled Model Intercomparison Project, Phase 3 (CMIP-3) data set used in the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report (AR4).
The Earth System Grid: Enabling Access to Multi-Model Climate Simulation Data History and impact of the Earth System Grid on the Climate Community. (BAMS Report published February 2009.) D N Williams, R Ananthakrishnan, D E Bernholdt, S Bharathi, D Brown, M Chen, A L Chervenak, L Cinquini, R Drach, I T Foster, P Fox, D Fraser, J Garcia, S Hankin, P Jones, D E Middleton, J Schwidder, R Schweitzer, R Schuler, A Shoshani, F Siebenlist, A Sim, W G Strand, M Su, N. Wilhelmi, “The Earth System Grid: Enabling Access to Multi-Model Climate Simulation Data”, in the Bulletin of the American Meteorological Society, February 2009.
The Planet at Their Fingertips: Climate Modeling Data Heats Up
Overview of the importance of the Earth System Grid to the Climate Community (Upcoming SciDAC Review Article).
D. N. Williams, R. Ananthakrishnan, D. E. Bernholdt, S. Bharathi, D. Brown, M. Chen, A. L. Chervenak, L. Cinquini, R. Drach, I. T. Foster, P. Fox, S. Hankin, V. E. Henson, P. Jones, D. E. Middleton, J. Schwidder, R. Schweitzer, R. Schuler, A Shoshani, F. Siebenlist, A. Sim, W. G. Strand, N. Wilhelmi, M. Su, “The Planet at Their Fingertips: Climate Modeling Data Heats Up”, in the SciDAC Review Magazine, Issue 9, Spring 2009.
Extreme Scale Computing Workshop Joint Office of Biological and Environmental Research (BER) and the Office of Advanced Scientific Computing Research (ASCR) on challenges in climate change science and the role of computing at the extreme scale. December, 2008.
Data Management and Analysis for the Earth System Grid
Overview of climate data management challenges and server-side analysis in ESG (SciDAC 2008 Conference).
D. N. Williams, R. Ananthakrishnan, D. E. Bernholdt, S. Bharathi, D. Brown, M. Chen, A. L. Chervenak, L. Cinquini, R. Drach, I. T. Foster, P. Fox, S. Hankin, V. E. Henson, P. Jones, D. E. Middleton, J. Schwidder, R. Schweitzer, R. Schuler, A Shoshani, F. Siebenlist, A. Sim, W. G. Strand, N. Wilhelmi, M. Su, “Data Management and Analysis for the Earth System Grid”, in the Journal of Physics: Conference Series, SciDAC ‘08 conference proceedings, volume 125. ([Citation:] D N Williams et al 2008 J. Phys.: Conf. Ser. 125 012072)
Web Enabled Collaborative Climate Visualization in the Earth System Grid Kendall, W.; Glatter, M.; Jian Huang; Hoffman, F.; Bernholdt, D.E.; Collaborative Technologies and Systems, 2008. CTS 2008. International Symposium on 19-23 May 2008 Page(s):212 - 220
Advanced Scientific Computing Advisory Committee and Biological and Environmental Advisory Committee; Prepared Joint ASCAC-BERAC Subcommittee report on computational and informational technology rate limiters to the advancement of climate change science. March, 2008
Computational and informational technology rate limiters to the advancement of climate change science;
A short overview of ESG-CET in the CTWatch Quarterly November 2007 special issue on Software Enabling Technologies for Petascale Science.
Dean N. Williams, David E. Bernholdt, Ian T. Foster, Don E. Middleton, “The Earth System Grid Center for Enabling Technologies: Enabling Community Access to Petascale Climate Datasets”, in the Cyberinfrastructure Technology Watch (CTWatch) Quarterly, November 2007, vol 3 number 4.
BER Science Network Requirements Report on the Biological and Environmental Research Network Requirements Workshop. The Earth System Grid network requirements are location in section 2.3 on page 12. July 2007
Building a global federation system for climate change research: the Earth System Grid Center for Enabling Technologies (ESG-CET)
An overview of the ESG-CET project written for the SciDAC 2007 conference.
R Ananthakrishnan, D E Bernholdt, S Bharathi, D Brown, M Chen, A L Chervenak, L Cinquini, R Drach, I T Foster, P Fox, D Fraser, K Halliday, S Hankin, P Jones, C Kesselman, D E Middleton, J Schwidder, R Schweitzer, R Schuler, A Shoshani, F Siebenlist, A Sim, W G Strand, N. Wilhelmi, M Su, and D N Williams, “Building a Global Federation System for Climate Change Research: The Earth System Grid Center for Enabling Technologies (ESG-CET)”, in the Journal of Physics: Conference Series, SciDAC ’07 conference proceedings. ([Citation]: R Ananthakrishnan et al 2007 J. Phys.: Conf. Ser. 78 012050)