SUNGWOOK YOON
Updated 204 days ago
We worked with a few fortune 500 companies for their IT security data analysis projects for several months. We used Spark to enrich the streaming data and used ES to Spark to ingest into Elasticsearch Visualization. We developed machine learning system using Spark MLLib for the baseline analysis and traffic pattern. We also used Spark GraphX to develop consistent network topology of the customer network. PageRank algorithm and Connected Component analysis in GraphX help the customer easily find significant lateral data movement.We used Scala for Spark development. Upon customers request, we perform Pyspark demo.