LexisNexis Learn Academy welcomes to KSU 2020 Fall Hackathon.
For this challenge you are presented with two pre-scheduled flight datasets. 2019 and 2020 global direct flight schedules. Direct flights are flights from airport A (Departure Station) to airport B (Arrival Station). If you want to look at connection flights from A to B to C, you need to build them, keep in mind arrival/departure time and dates :)
Each flight dataset contains a year of schedules from the month it's established. For example May2020 file will have all schedule flights till May 2021.
Keep in mind that DiscontinueDate can go over a year, based on how long that flight should operate. For example, a scheduled flight can operate from (EffectiveDate) 06/01/2020 t0 07/23/2023 (DiscontinueDate).
Cirium our sister company has provided the data. For more information please visit Cirium.
Start with creating a login in CloudIDE. User guide is available under Help in CloudIDE, also can be found in this repository.
Flights_Workshop has the initial code you need for this challenge.
If you need more information on jobs you are running please use ECL Watch Page
RealBI is the visualization tool for creating charts and dashboards. To start please email your name, email and IP address to Chris Human(Christopher.Human@lexisnexisrisk.com) to request login.
RealBI is connected to the same cluster, so no pain of moving your data, just make sure your results are saved in files. You can use RealBI built-in ECL script to aggregate data for visualization on the fly. User guide is available in the application and in this repository.
For a quick start on ECL syntax, please use Learn ECL. All sample code used in Learn ECL is available LearnECL workshop in CloudIDE.
-
More information on ECL: https://cdn.hpccsystems.com/releases/CE-Candidate-7.10.16/docs/EN_US/ECLLanguageReference_EN_US-7.10.16-1.pdf
-
Standard Library: https://cdn.hpccsystems.com/releases/CE-Candidate-7.10.16/docs/EN_US/ECLStandardLibraryReference_EN_US-7.10.16-1.pdf
-
Couple short videos on intro to ECl: https://www.youtube.com/watch?time_continue=192&v=Lk78BCCtM-0
-
ECL cheat sheet pdf format: https://github.com/hpccsystems-solutions-lab/KSU-2020-Hackathon/blob/master/ECL_Cheat_Sheet.pdf
-
Machine Learning: https://hpccsystems.com/download/free-modules/machine-learning-library
Judges will consider followings during final presentation:
- Problem that was chosen
- How you approached the solution
- Display results
- Drawing conclusion
- Demo of work via a PowerPoint presentation or live demo
Lili Xu is an ECL Developer, she is an expert mater in Machine Learning and Data Analytics.
Chris Human is our RealBI Developer, new to ECL world, but an expert matter on visualization and dashboards.
Jeremy Clements has been developing CloudIDE, good with ECL and expert on application development.
Bahar Fardanian, our technology evangelist, ECL developer and a mentor. She is RealBI and CloudIDE product owner.