Lets Stop Wildfires Hackathon 2.0
GOAL: Build Deployable Wildfire Smoke Detection Models for HPWREN Cameras
- Hackathon Information Session on Sunday, June 28 at 9 am Pacific Time. Register to attend this zoom session.
- Lets Annotate Wildfire Smoke Images on Saturday, May 30 at 10 am Pacific Time
Lets Stop Wildfires Hackathon 2.0 is a reboot of the last successful wildfires hackathon organized by AI For Mankind.
In the last Lets Stop Wildfires Hackathon which was launched in 2019, we focused on classification of smoke on the whole image or gridded image. In this hackathon, we want to formulate the problem as smoke detection and segmentation. We present the following challenges for our participants to solve. Special thanks to High Performance Wireless Research and Education Network (HPWREN) to provide access to HPWREN camera images.
- Detect Wildfire Smoke using Bounding Boxes
- Detect Wildfire Smoke using Segmentation Masks
- Bonus: Detect Wildfire Smoke using Temporal Sequences.
- Bonus: Real Time On Device Wildfire Smoke Detector.
Do you know there are many cameras installed around mountaintop in California. These are the HPWREN and AlertWildfire cameras.
We believe that open sharing and collaboration are important in accelerating innovation and driving meaningful change locally and globally. Public and private partnerships coupled with citizen participation can help win the fight against wildfires.
Everything built during the hackathon will remain as open source with The MIT license.
High Performance Wireless Research and Education Network (HPWREN)
The High Performance Wireless Research and Education Network (HPWREN), a University of California San Diego partnership project led by the San Diego Supercomputer Center and the Scripps Institution of Oceanography’s Institute of Geophysics and Planetary Physics, supports Internet-data applications in the research, education, and public safety realms.
AI For Mankind’s Wildfire Smoke Detector
Can your wildfire smoke detector beat the “AI For Mankind: SUPER DUPER WILDFIRE SMOKE DETECTOR” ? We need your help and expertise in building a better and improved wildfire smoke detector.
AI For Mankind had annotated 744 wildfire smoke HPWREN images in 2019 and built a wildfire smoke detector aka “The Super Duper” using the annotated images. It has shown promising results running against wildfire images captured by HPWREN in 2020. See our wildfire smoke detector results below.
2020-02-05 fire captured by HPWREN camera hp-w-mobo-c, our detector detected the smoke 13 minutes after fire ignition.
2020-03-06 fire captured by HPWREN camera mlo-n-mobo-c, our detector detected the smoke 3 minutes after fire ignition. See video below.
2020-05-21 fire captured by HPWREN camera VEGMGMT ml-w-mobo-c, our detector detected the smoke 16 minutes after fire ignition.
Other True Positives
We ran AI For Mankind’s wildfire smoke detector aka “The Super Duper” against past HPWREN images of several fires, here are the promising results obtained.
- 20191006: Detected smoke ~6 mins after fire ignition (HPWREN ml w mobo c) https://youtu.be/wt1sQyRjoCI
- 20191006: Detected smoke ~7 mins after fire ignition (HPWREN lp n mobo c) https://youtu.be/dViR_XGQ8Oo
- 20191006: Detected smoke ~3 mins after fire ignition (HPWREN pi s mobo c) https://youtu.be/e9T_8coM20M
- 20191007: Detected smoke ~10 mins after fire ignition (HPWREN sm s mobo c) https://youtu.be/LqAxrY-Xa4w
- 20200206: Detected smoke ~4 mins after fire ignition (HPWREN ml s mobo c) https://youtu.be/Y3tal1-nk1Y
- 20200306: Detected smoke ~3 mins after fire ignition (HPWREN mlo n mobo c) https://youtu.be/X_QvjA1-Nb4
- 20200205: Detected smoke ~13 mins after fire ignition (HPWREN hp w mobo c) https://youtu.be/CcbXdcMEQvs
In this hackathon, we provide our wildfire smoke detector repo with the same annotated images to get you started and challenge you all to build a better and improved model to beat our detector.
You can checkout our wildfire smoke detector repo below. It comes with a docker image and annotated HPWREN images to get you started.
- Wildfire Smoke Detector Quickstart Repo. Follow the steps to build a simple wildfire smoke detector.
You can also checkout the following notebooks for smoke classification provided by us for the last hackathon. These are built only for classification and not for object detection.
Smoke Classifier using Entire Image
Smoke Classifier using Gridded Image
In the above repo, you will find 744 bounding box annotated HPWREN wildfire smoke images.
3292 Total Number of Images, 744 of them are annotated with bounding boxes.
PASCAL VOC Annotations
We had developed 3 models: SuperDuper-v1, SuperDuper-v2, and SuperDuper-edge using the same provided dataset above. One of them, SuperDuper-edge is optimized for edge device. The table shows the performance of our models.
We hope one of you will come up with a better detection model.
False Positive Rate
We tested our model against different time periods eg. during sunrise, sunset, or foggy condition and shared our false positive rates below. Your submitted model will be evaluated against these conditions too.
|False Positive Study|
|Model||Total Images||Num of False Positives||False Positive Rate||Link to Dataset|
On average, false positive rate ~0.0860
Other Useful Resources
- Colab Notebook for developing deep learning application on free GPU
- Colab Notebook for Image Segmentation
Wildfire Smoke Classifier using Google Colab
- FUEGO firecam repo
See some sample HPWREN pictures below. Can you detect the smoke ?
How Challenging to Detect Wildfire Smoke
It is very challenging to detect these wildfire smokes. See the following HPWREN examples.
See this far away smoke video
Can you see the smoke in the following images ?
Our previous hackathon was a success. Participants engaged in discussions shown in pics below.
Mentors for Hackathon
- Adam Kraft Machine Learning Engineer from Google Brain
- Jianming Zhang, Senior Research Scientist from Adobe Research
- Vladimir Iglovikov Kaggle Grandmaster, Senior Computer Vision Engineer at Level5, Self-Driving Division, Lyft Inc.
Note: If you wish to keep your idea/project private, please do not enter this hackathon.
Submission due date for this hackathon is Aug 23, 2020 at 11:59 pm Pacific Time. For submission, please provide your hackathon Github repo describing your model and how to reproduce the model including the model config file you use to train your model. Most importantly, please include the link to your model (frozen inference graph in protocol buffer format). Dropbox/Google Drive link works the best for large models. We will load your model and benchmark against our best models using unseen test images.
See instruction of the provided quick start repo https://github.com/aiformankind/wildfire-smoke-detection-camera on how to generate a frozen inference graph in protocol buffer format.
If you have any questions, please feel free to email us at firstname.lastname@example.org
Join Our Slack Channel
Join Our Meetup Group
- Join AI For Mankind Meetup Group to receive event announcement.
By participating in this hackathon, participants agree to be bound by all of the terms and conditions as set out below.
You have to register HERE to participate in the hackathon. Last day to register is Aug 2, 2020.
- This hackathon is open to everyone at least 18 years old. If you are in high school and would like to participate, you will be paired with another participant who will serve as a mentor.
The hackathon starts on Saturday June 20, 2020 at 9AM PT and ends on Sunday Aug 23, 2020 at 11:59PM PT.
Note: Hackathon end dates are at the sole discretion of AI For Mankind and may be subject to change.
Teams must be comprised of 1-5 people.
You have to create a public github repository for your entry with the MIT License.
Participants are not allowed to enter in projects containing confidential information or subject to the proprietary rights of any person or entity.
How Will My Entry be Potentially Used?
By participating in the hackathon, you agree to ALL of the following statements:
You understand and acknowledge that your entry/submission in their entirety will become open source (MIT License) and made publicly available to everyone. You agree to make any code produced/submitted for the hackathon (your entry’s github repository) available under the terms of The MIT License and other created works under the terms of the CC BY-SA 4.0 licence. Participant hereby irrevocably licenses all Work Product under the MIT License located at https://opensource.org/licenses/MIT. “Work Product” means all ideas, concepts, proposals, materials, and all other work product of any nature whatsoever, that are created, prepared, produced, conceived, or reduced to practice by Participant solely or jointly with others during the Hackathon. Participant represents and warrants that, to the best of his or her knowledge, the Work Product is and will be Participant’s own original work and does not and will not infringe the intellectual property or proprietary rights of any third party, including, without limitation, any third party patents, copyrights or trademarks.
- You understand and acknowledge that after the submission deadline has passed, your project (github repository) that has been submitted to the hackathon cannot be deleted or made private. Your project repository will also be featured on the AI For Mankind Let’s Stop Wildfires hackathon 2.0 github page after the hackathon has concluded.
- You understand and acknowledge that others may have developed or commissioned materials similar or identical to your entry and you waive any claims you may have resulting from any similarities to your entry.
- You understand that you will not receive any compensation for use of your entry.
Note: If you do not agree to above and want to keep your idea/project private, please do not enter this hackathon.
Rules of Conduct
- Respect each other.
- Do not violate copyrights, trademarks, or other such rights.
- Observe data protection legislation.
Note: Teams can be disqualified from the competition at the organizer’s discretion. Reasons might include but are not limited to breaking the Hackathon Rules or other unsporting behavior.
- The MIT License
- CC BY-SA 4.0 Licence
Reach out to us if you are interested in sponsoring the hackathon.
Donate to the prize money. Your tax-deductible donation today will help support our mission.
AI For Mankind is a 501(c)(3) nonprofit organization. EIN 84-1750651
- FUEGO Wildfire Detection Slides by Kinshuk Govil
- A Review on Forest Fire Detection Techniques
- Wildland Fire Assessment System
- The United States Fourth National Climate Assessment Volume II
- How Wildfire Works
- Fighting Wildfires
- Wildland Fire: What is Hazard Fuel Reduction?
- Tensorflow Quickstart
- Tensorflow Tutorials
- Install Tensorflow in PyCharm
- What is transfer learning? Exploring the popular deep learning approach
- Transfer learning in TensorFlow 2 tutorial
- Deep learning unbalanced training data
- Do Better ImageNet Models Transfer Better?
- SpotTune: Transfer Learning through Adaptive Fine-tuning
- Taskonomy: Disentangling Task Transfer Learning