Add description.

docs/AI/AtomGen/carbon24_energy_per_atom.md

@@ -1,4 +1,6 @@
 # Model for carbon material design
+<!--benchmark_description--> - Description: This is a benchmark to evaluate how accurately a generative model can generate atomic structures with desired formation energy per atom using the carbon24 dataset. The dataset contains different types of chemical formula and atomic structures. Here we use root mean squared error (RMSE) for bond lengths to compare models. External links: https://github.com/txie-93/cdvae, https://arxiv.org/abs/2110.06197, 
+
 
 <h2>Model benchmarks</h2>
 

docs/AI/AtomGen/dft_3d_Tc_supercon.md

@@ -1,4 +1,7 @@
 # Model for 3D superconductor design
+<!--benchmark_description--> - Description: This is a benchmark to evaluate how accurately a generative model can generate atomic structures with desired super critical transition temperature (Tc) using the JARVIS-DFT (dft_3d) dataset. The dataset contains different types of chemical formula and atomic structures. Here we use root mean squared error (RMSE) for bondlengths to compare models. External links: https://github.com/txie-93/cdvae, https://arxiv.org/abs/2110.06197, https://pubs.acs.org/doi/10.1021/acs.jpclett.3c01260
+
+
 
 <h2>Model benchmarks</h2>
 

docs/AI/AtomGen/index.md

@@ -3,8 +3,8 @@ Inverse Atomic Structure Design
 See: https://doi.org/10.1021/acs.jpclett.3c01260
 
 [Colab notebook example](https://colab.research.google.com/github/knc6/jarvis-tools-notebooks/blob/master/jarvis-tools-notebooks/cdvae_example.ipynb) 
-<!--number_of_contributions--> - Number of contributions: 1
+<!--number_of_contributions--> - Number of contributions: 3
 
 
 
-<!--table_content--><table style="width:100%" id="j_table"><thead><tr><th>Category</th><th>Sub-category</th><th>Benchmark</th><th>Method</th><th>Metric</th><th>Score</th><th>Team</th><th>Dataset</th><th>Size</th></tr></thead><tr><td><a href= "./AI" target="_blank">AI</a></td><td><a href= "./AI/AtomGen" target="_blank">AtomGen</a></td><td><a href= "./dft_3d_Tc_supercon" target="_blank">dft_3d_Tc_supercon</a></td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/cdvae_model" target="_blank">cdvae_model</a></td><td>RMSE</td><td>0.3557</td><td>CDVAE</td><td>dft_3d</td><td>1056</td></tr><!--table_content--></table>
+<!--table_content--><table style="width:100%" id="j_table"><thead><tr><th>Category</th><th>Sub-category</th><th>Benchmark</th><th>Method</th><th>Metric</th><th>Score</th><th>Team</th><th>Dataset</th><th>Size</th></tr></thead><tr><td><a href= "./AI" target="_blank">AI</a></td><td><a href= "./AI/AtomGen" target="_blank">AtomGen</a></td><td><a href= "./carbon24_energy_per_atom" target="_blank">carbon24_energy_per_atom</a></td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/cdvae_model" target="_blank">cdvae_model</a></td><td>RMSE</td><td>0.3581</td><td>CDVAE</td><td>carbon24</td><td>10153</td></tr><tr><td><a href= "./AI" target="_blank">AI</a></td><td><a href= "./AI/AtomGen" target="_blank">AtomGen</a></td><td><a href= "./dft_3d_Tc_supercon" target="_blank">dft_3d_Tc_supercon</a></td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/cdvae_model" target="_blank">cdvae_model</a></td><td>RMSE</td><td>0.3557</td><td>CDVAE</td><td>dft_3d</td><td>1056</td></tr><!--table_content--></table>

docs/AI/AtomGen/perov5_heat_ref.md

@@ -1,4 +1,6 @@
 # Model for perovskite material design
+<!--benchmark_description-->
+
 
 <h2>Model benchmarks</h2>
 

docs/AI/ImageClass/index.md

@@ -7,4 +7,4 @@ See: https://github.com/usnistgov/atomvision
 
 
 
-<!--table_content--><table style="width:100%" id="j_table"><thead><tr><th>Method</th><th>Task</th><th>Property</th><th>Model name</th><th>Metric</th><th>Score</th><th>Team</th><th>Dataset</th><th>Size</th></tr></thead><tr><td><a href= "./AI" target="_blank">AI</a></td><td><a href= "./AI/ImageClass" target="_blank">ImageClass</a></td><td><a href= "./stem_2d_image_bravais_class" target="_blank">stem_2d_image_bravais_class</a></td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model" target="_blank">densenet_model</a></td><td>ACC</td><td>0.83</td><td>JARVIS</td><td>stem_2d_image</td><td>9150</td></tr><!--table_content--></table>
+<!--table_content--><table style="width:100%" id="j_table"><thead><tr><th>Category</th><th>Sub-category</th><th>Benchmark</th><th>Method</th><th>Metric</th><th>Score</th><th>Team</th><th>Dataset</th><th>Size</th></tr></thead><tr><td><a href= "./AI" target="_blank">AI</a></td><td><a href= "./AI/ImageClass" target="_blank">ImageClass</a></td><td><a href= "./stem_2d_image_bravais_class" target="_blank">stem_2d_image_bravais_class</a></td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model" target="_blank">densenet_model</a></td><td>ACC</td><td>0.8304</td><td>JARVIS</td><td>stem_2d_image</td><td>9150</td></tr><!--table_content--></table>

docs/AI/ImageClass/stem_2d_image_bravais_class.md

@@ -1,4 +1,6 @@
 # Model for STEM 2D Image class
+<!--benchmark_description--> - Description: This is a benchmark to evaluate how accurately an AI image classification model can classify a Scanning transmission electron microscopy (STEM) image into a corresponding 2D bravais lattice. Here we use accuracy (ACC) of the image classification as a metric. External links: https://pubs.acs.org/doi/10.1021/acs.jcim.2c01533  
+
 
 <h2>Model benchmarks</h2>
 
@@ -14,5 +16,5 @@
     <th>Notes</th>
   </tr>
  </thead>
-<!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model" target="_blank">resnet_model</a></td><td>stem_2d_image</td><td>0.292</td><td>JARVIS</td><td>9150</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model/AI-ImageClass-bravais_class-stem_2d_image-test-acc.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/ImageClass/stem_2d_image_bravais_class.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model" target="_blank">densenet_model</a></td><td>stem_2d_image</td><td>0.83</td><td>JARVIS</td><td>9150</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model/AI-ImageClass-bravais_class-stem_2d_image-test-acc.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/ImageClass/stem_2d_image_bravais_class.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model/metadata.json " target="_blank">Info</a></td></tr><!--table_content-->
+<!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model" target="_blank">resnet_model</a></td><td>stem_2d_image</td><td>0.2924</td><td>JARVIS</td><td>9150</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model/AI-ImageClass-bravais_class-stem_2d_image-test-acc.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/ImageClass/stem_2d_image_bravais_class.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/resnet_model/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model" target="_blank">densenet_model</a></td><td>stem_2d_image</td><td>0.8304</td><td>JARVIS</td><td>9150</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model/AI-ImageClass-bravais_class-stem_2d_image-test-acc.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/ImageClass/stem_2d_image_bravais_class.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/densenet_model/metadata.json " target="_blank">Info</a></td></tr><!--table_content-->
 </table>

docs/AI/MLFF/alignn_ff_db_energy.md

@@ -1,4 +1,6 @@
 # Model for ALIGNN-FF energy
+<!--benchmark_description--> - Description: This is an AI benchmark to evaluate how accurately a machine learning force-field (MLFF) can predict the total energy using the relaxation trajectories (energy and forces of intermediate steps) of the JARVIS-DFT (dft_3d) dataset, calculated with the OPTB88vdw density functional. The dataset contains different types of chemical formula and atomic structures. Here we use mean absolute error (MAE) to compare MLFFs with respect to DFT (OPT) accuracy.  
+
 
 <h2>Model benchmarks</h2>
 
@@ -14,5 +16,5 @@
     <th>Notes</th>
   </tr>
  </thead>
-<!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained" target="_blank">m3gnet_pretrained</a></td><td>alignn_ff_db</td><td>1.762</td><td>M3GNET</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10" target="_blank">alignnff_wt10</a></td><td>alignn_ff_db</td><td>0.097</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1" target="_blank">alignnff_wt1</a></td><td>alignn_ff_db</td><td>0.051</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5" target="_blank">alignnff_wt0.5</a></td><td>alignn_ff_db</td><td>0.044</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1" target="_blank">alignnff_wt0.1</a></td><td>alignn_ff_db</td><td>0.034</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1/metadata.json " target="_blank">Info</a></td></tr><!--table_content-->
+<!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained" target="_blank">m3gnet_pretrained</a></td><td>alignn_ff_db</td><td>1.762</td><td>M3GNET</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/m3gnet_pretrained/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10" target="_blank">alignnff_wt10</a></td><td>alignn_ff_db</td><td>0.0973</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt10/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1" target="_blank">alignnff_wt1</a></td><td>alignn_ff_db</td><td>0.0509</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt1/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5" target="_blank">alignnff_wt0.5</a></td><td>alignn_ff_db</td><td>0.0443</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.5/metadata.json " target="_blank">Info</a></td></tr><!--table_content--><tr><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1" target="_blank">alignnff_wt0.1</a></td><td>alignn_ff_db</td><td>0.0342</td><td>JARVIS</td><td>307111</td><td>01-14-2023</td><td><a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1/AI-MLFF-energy-alignn_ff_db-test-mae.csv.zip" target="_blank">CSV</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/benchmarks/AI/MLFF/alignn_ff_db_energy.json.zip" target="_blank">JSON</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1/run.sh " target="_blank">run.sh</a>, <a href="https://github.com/usnistgov/jarvis_leaderboard/tree/main/jarvis_leaderboard/contributions/alignnff_wt0.1/metadata.json " target="_blank">Info</a></td></tr><!--table_content-->
 </table>