Lets Stop Wildfires Hackathon 2.0

wildfire Smoke Detector in Action wildfire Smoke Detector in Action

GOAL: Build Deployable Wildfire Smoke Detection Models for HPWREN Cameras

REGISTER NOW

Upcoming Events

Stay tuned

Past Events


Lets Stop Wildfires Hackathon 2.0 is a reboot of the last successful wildfires hackathon organized by AI For Mankind.

In the last Lets Stop Wildfires Hackathon which was launched in 2019, we focused on classification of smoke on the whole image or gridded image. In this hackathon, we want to formulate the problem as smoke detection and segmentation. We present the following challenges for our participants to solve. Special thanks to High Performance Wireless Research and Education Network (HPWREN) to provide access to HPWREN camera images.

  1. Detect Wildfire Smoke using Bounding Boxes
  2. Detect Wildfire Smoke using Segmentation Masks
  3. Bonus: Detect Wildfire Smoke using Temporal Sequences.
  4. Bonus: Real Time On Device Wildfire Smoke Detector.

Do you know there are many cameras installed around mountaintop in California. These are the HPWREN and AlertWildfire cameras.

We believe that open sharing and collaboration are important in accelerating innovation and driving meaningful change locally and globally. Public and private partnerships coupled with citizen participation can help win the fight against wildfires.

Everything built during the hackathon will remain as open source with The MIT license.

Our Collaborators

High Performance Wireless Research and Education Network (HPWREN) HPWREN

The High Performance Wireless Research and Education Network (HPWREN), a University of California San Diego partnership project led by the San Diego Supercomputer Center and the Scripps Institution of Oceanography’s Institute of Geophysics and Planetary Physics, supports Internet-data applications in the research, education, and public safety realms.


AI For Mankind’s Wildfire Smoke Detector

Can your wildfire smoke detector beat the “AI For Mankind: SUPER DUPER WILDFIRE SMOKE DETECTOR” ? We need your help and expertise in building a better and improved wildfire smoke detector.

AI For Mankind had annotated 744 wildfire smoke HPWREN images in 2019 and built a wildfire smoke detector aka “The Super Duper” using the annotated images. It has shown promising results running against wildfire images captured by HPWREN in 2020. See our wildfire smoke detector results below.

  1. 2020-02-05 fire captured by HPWREN camera hp-w-mobo-c, our detector detected the smoke 13 minutes after fire ignition.



  2. 2020-03-06 fire captured by HPWREN camera mlo-n-mobo-c, our detector detected the smoke 3 minutes after fire ignition. See video below.




  3. 2020-05-21 fire captured by HPWREN camera VEGMGMT ml-w-mobo-c, our detector detected the smoke 16 minutes after fire ignition.
    Wildfire Smoke Detector in Action

Other True Positives

We ran AI For Mankind’s wildfire smoke detector aka “The Super Duper” against past HPWREN images of several fires, here are the promising results obtained.

In this hackathon, we provide our wildfire smoke detector repo with the same annotated images to get you started and challenge you all to build a better and improved model to beat our detector.


GET STARTED

You can checkout our wildfire smoke detector repo below. It comes with a docker image and annotated HPWREN images to get you started.

  1. Wildfire Smoke Detector Quickstart Repo. Follow the steps to build a simple wildfire smoke detector.

You can also checkout the following notebooks for smoke classification provided by us for the last hackathon. These are built only for classification and not for object detection.

  1. Smoke Classifier using Entire Image

  2. Smoke Classifier using Gridded Image

Wildfire Smoke Detector in ActionWildfire Smoke Detector in Action

detected smoke 1detected smoke 2

DATASET

In the above repo, you will find 744 bounding box annotated HPWREN wildfire smoke images.

3292 Total Number of Images, 744 of them are annotated with bounding boxes.

PASCAL VOC Annotations

Model Performance

We had developed several models: SuperDuper-v1, SuperDuper-v2, and SuperDuper-edge using the same provided dataset above. One of them, SuperDuper-edge is optimized for edge device.

We hope one of you will come up with a better detection model.

False Positive Rate

We tested our model against different time periods eg. during sunrise, sunset, or foggy condition and shared our false positive rates below. Your submitted model will be evaluated against these conditions too.

False Positive Study          
  Model Total Images Num of False Positives False Positive Rate Link to Dataset
Sunrise SuperDuper-v1 181 2 0.011 https://www.dropbox.com/sh/71jdkv7tdtmmif8/AACdd51AH4BNX84bJSrGWrssa?dl=0
Fog SuperDuper-v1 181 72 0.398 https://www.dropbox.com/sh/iw40v0yrkkimhha/AAANC4cxJR90cp8cfXF5kYHaa?dl=0

On average, false positive rate ~0.0860

Other Useful Resources

  1. Colab Notebook for developing deep learning application on free GPU
  2. Colab Notebook for Image Segmentation

  3. Wildfire Smoke Classifier using Google Colab

  4. FUEGO firecam repo

See some sample HPWREN pictures below. Can you detect the smoke ?

Image from one of HPWREN camera Image from one of HPWREN camera

How Challenging to Detect Wildfire Smoke

It is very challenging to detect these wildfire smokes. See the following HPWREN examples.

See this far away smoke video

Can you see the smoke in the following images ?

far away smokefar away smoke

Our previous hackathon was a success. Participants engaged in discussions shown in pics below.

Participants in discussion in last hackathon Participants in discussion in last hackathon

Mentors for Hackathon

  1. Adam Kraft Machine Learning Engineer from Google Brain
  2. Jianming Zhang, Senior Research Scientist from Adobe Research
  3. Vladimir Iglovikov Kaggle Grandmaster, Senior Computer Vision Engineer at Level5, Self-Driving Division, Lyft Inc.

Note: If you wish to keep your idea/project private, please do not enter this hackathon.

Submission

Submission due date for this hackathon is Aug 23, 2020 at 11:59 pm Pacific Time. For submission, please provide your hackathon Github repo describing your model and how to reproduce the model including the model config file you use to train your model. Most importantly, please include the link to your model (frozen inference graph in protocol buffer format). Dropbox/Google Drive link works the best for large models. We will load your model and benchmark against our best models using unseen test images.

See instruction of the provided quick start repo https://github.com/aiformankind/wildfire-smoke-detection-camera on how to generate a frozen inference graph in protocol buffer format.

Contact Us

If you have any questions, please feel free to email us at ai.for.mankind@gmail.com

Join Our Slack Channel

Join Our Meetup Group

By participating in this hackathon, participants agree to be bound by all of the terms and conditions as set out below.

You have to register HERE to participate in the hackathon. Last day to register is Aug 2, 2020.

Eligibility

  1. This hackathon is open to everyone at least 18 years old. If you are in high school and would like to participate, you will be paired with another participant who will serve as a mentor.

Hackathon Period

The hackathon starts on Saturday June 20, 2020 at 9AM PT and ends on Sunday Aug 23, 2020 at 11:59PM PT.

Note: Hackathon end dates are at the sole discretion of AI For Mankind and may be subject to change.

Requirements

  1. Teams must be comprised of 1-5 people.

  2. You have to create a public github repository for your entry with the MIT License.

  3. Participants are not allowed to enter in projects containing confidential information or subject to the proprietary rights of any person or entity.

How Will My Entry be Potentially Used?

By participating in the hackathon, you agree to ALL of the following statements:

  1. You understand and acknowledge that your entry/submission in their entirety will become open source (MIT License) and made publicly available to everyone. You agree to make any code produced/submitted for the hackathon (your entry’s github repository) available under the terms of The MIT License and other created works under the terms of the CC BY-SA 4.0 licence. Participant hereby irrevocably licenses all Work Product under the MIT License located at https://opensource.org/licenses/MIT. “Work Product” means all ideas, concepts, proposals, materials, and all other work product of any nature whatsoever, that are created, prepared, produced, conceived, or reduced to practice by Participant solely or jointly with others during the Hackathon. Participant represents and warrants that, to the best of his or her knowledge, the Work Product is and will be Participant’s own original work and does not and will not infringe the intellectual property or proprietary rights of any third party, including, without limitation, any third party patents, copyrights or trademarks.

  2. You understand and acknowledge that after the submission deadline has passed, your project (github repository) that has been submitted to the hackathon cannot be deleted or made private. Your project repository will also be featured on the AI For Mankind Let’s Stop Wildfires hackathon 2.0 github page after the hackathon has concluded.
  3. You understand and acknowledge that others may have developed or commissioned materials similar or identical to your entry and you waive any claims you may have resulting from any similarities to your entry.
  4. You understand that you will not receive any compensation for use of your entry.

Note: If you do not agree to above and want to keep your idea/project private, please do not enter this hackathon.

Rules of Conduct

  1. Respect each other.
  2. Do not violate copyrights, trademarks, or other such rights.
  3. Observe data protection legislation.

Note: Teams can be disqualified from the competition at the organizer’s discretion. Reasons might include but are not limited to breaking the Hackathon Rules or other unsporting behavior.

References

  1. The MIT License
  2. CC BY-SA 4.0 Licence

Sponsors

Stay Tuned

Reach out to us if you are interested in sponsoring the hackathon.

Prize Money

Stay Tuned

Donate to the prize money. Your tax-deductible donation today will help support our mission.

AI For Mankind is a 501(c)(3) nonprofit organization. EIN 84-1750651

Wildfire Resources

  1. FUEGO Wildfire Detection Slides by Kinshuk Govil
  2. A Review on Forest Fire Detection Techniques
  3. Wildland Fire Assessment System
  4. The United States Fourth National Climate Assessment Volume II
  5. How Wildfire Works
  6. Fighting Wildfires
  7. Wildland Fire: What is Hazard Fuel Reduction?

Tensorflow Resources

  1. Tensorflow Quickstart
  2. Tensorflow Tutorials
  3. Install Tensorflow in PyCharm
  4. What is transfer learning? Exploring the popular deep learning approach
  5. Transfer learning in TensorFlow 2 tutorial
  6. Deep learning unbalanced training data

Papers

  1. Do Better ImageNet Models Transfer Better?
  2. SpotTune: Transfer Learning through Adaptive Fine-tuning
  3. Taskonomy: Disentangling Task Transfer Learning