2016年7月16日 星期六

A new journey in Levyx, Inc and More

Turn a new page

After spamming all the companies and startups nearby, I finally got a position in Levyx, Inc. This is a great to place to work, hmm... not exactly only but learn much as well. Great place, nice people, awesome food and free environment make me enjoying here so much!


Diving into Big Data

One of the important goals for me to choose working here is that I can take this awesome opportunity to learn the things that I couldn't learn by myself in terms of resources, environment, and timing.

Before the work, I was told to get familiar with Scala which is a functional programming running on JVM. The reason is that the framework we are using now, the Spark is based on Scala (actually, it does support Python and R natively). 


Spark is a framework which emphasizes on the parallel processing of the data. When you start dealing with Spark, you will get overwhelmed with the term, "RDD" which is "Resilient Distributed Datasets". Because of the power of RDD, Spark could result in high performance in data processing as well as other application like Machine Learning and MapReduce.

Once more thing, I got the access to some "powerful" machines as well for the profiling. The "powerful" I talked here is about 60+ cores and 200GB+ memory with 3TB+ SSD. I will find a better way to utilize (or torture) these machines. 😎

Oh, by the way...

I am still in California for this internship. Yes, I will go back in September. See you guys there~~~


沒有留言:

張貼留言