Episode 170: Big Data with Lance Olson and Matt Winkler

Play Episode 170: Big Data with Lance Olson and Matt Winkler

Description

In this episode Chris Risner and Haishi Bai are joined by Lance Olson and Matt Winkler, Program Managers working on Big Data at Microsoft.  This episode starts a 5 episode mini-series focusing on Big Data.  In part one, Lance and Matt give an overview of what Big Data is and how it is used.  Big Data encompasses several different technologies but a large part of the focus is being able to handle massive amounts of different types of data and run queries and analytics on it quickly. This also includes the ability to do predictive analysis by creating models based off of the data.  There are many different technologies running in Azure that are associated with Big Data, including: HDInsight, Stream Analytics, Machine Learning, Event Hubs, Data Factory, Search, SQL Database, DocumentDB, and more.  Join Lance and Matt as they explain the basics and go over different technologies in Azure can be used to solve Big Data problems!

Links from the show:

Like Cloud Cover on Facebook!



Tags:

Azure, Big Data

Embed

Download

Download this episode

The Discussion

  • User profile image
    Spectate​Swamp1

     
    Detailed archiving of your info; be it family albums or music files will be an ongoing task but well worthwhile.
    With a few keystrokes you can automatically catalog existing "MPG" video, "MP3" audio, "JPG" pictures and "TXT" email records & notes etc.
    Moments later you will be randomly sampling your data treasures.
       
    It takes some time for Your personal database to become large enough to make searching interesting. If your memory is short then not so long.
     
    This app plows through text files at 20,000,000 CPS and beyond on a 8 year old LapTop..
     
    I have completed over 4 Dozen Telephone and CableSystem billing conversions (ETL) 95% of that data came
    in text files, a small percent was packed integer and real numbers etc. The Export data included toll files, work orders, customer details etc. These data were no problem for this app.
     
    Many of these IT jobs were for some of the largest companies in the Western Canada and US.
    The so called "Big Data" isn't that BIG for today's computers. I have more personal data than all the ETLs combined!!!
     
    To keep You in touch with the massive amounts of DATA you'll collect; the app can randomly sample Video or audio segments as easily as family pictures.
    Text data can be displayed "in context" or "matching lines only" along with match counts, line counts and elapsed time.
     
    Without a Random option; computer resources go unused and your data mining tools will fall short.
    Video playback options such as Fast Forward, Slow Motion and Large font captioning mixed with Video segments are a few of the
    main features. There is no more useful app than this.
     
    See the thread "nobody shares knowledge better than this" for all the details
     

Conversation locked

This conversation has been locked by the site admins. No new comments can be made.