{"id":399,"date":"2013-01-14T22:37:16","date_gmt":"2013-01-14T22:37:16","guid":{"rendered":"https:\/\/blogs.poly.com\/?p=399"},"modified":"2013-01-14T22:37:16","modified_gmt":"2013-01-14T22:37:16","slug":"future-of-big-data","status":"publish","type":"post","link":"https:\/\/blogs.poly.com\/future-of-big-data\/","title":{"rendered":"Future of Big Data"},"content":{"rendered":"

Every day we create 2.5 quintillion bytes of data.\u00a0 90% of the data in the world today has been created in the last two years.\u00a0 This data is a combination of everything you could imagine.\u00a0 It could be data from the Large Hadron Collider, posts to Facebook, pictures on Imgur, YouTube Videos, Amazon transaction records, and much, much more.\u00a0 When so much data gets collected the question becomes, what do you do with it all?\u00a0 Simply too much data exists for conventional methods to keep track of or any one person to monitor.\u00a0 Gartner analyst Doug Laney defined the growth of our data as being three dimensional.\u00a0 The 3Vs model, as Laney calls it, describes big data as increasing in Volume (amount of Data), Velocity (speed of Data in and out), and Variety (range of data types and sources). IBM even added a 4th<\/sup> dimension, Veracity.\u00a0 So how will we deal with big data in the future as it grows even more?\u00a0 How do we turn all this information into opportunity?<\/p>\n

Big Data provides lots of opportunity for companies, allowing them to use sources of information that were previously untapped.\u00a0 Learning about customer needs and complaints, current device ownership, and unspeakable amounts of other information can lead a company on the right path to growing their business.\u00a0 That information may lead to partnering with another vendor, or releasing new upgrades, or even fixing problems you didn\u2019t know existed.\u00a0 Big Data mining also can help with fraud analysis.\u00a0 Although financial service companies don\u2019t need to use big data to uncover fraud, incorporating data from other sources can always help them find problems quicker.\u00a0 Same goes for law enforcement.<\/p>\n

Analyzing, storing, and moving data in a cost effective manner becomes an important issue.\u00a0 Experts state that there is nothing more cost effective and time saving than being able to analyze the data as a stream in real time, instead of after you move and store it.\u00a0 This prevents storing useless information for long periods of time.\u00a0 You have to be careful not to trash any information too quickly.\u00a0 After all, data that isn\u2019t important today may be what you base your decisions on tomorrow.<\/p>\n

Some companies have built infrastructures around big data, focusing on collecting it, analyzing it with software and teams of talented personnel, and ultimately trying to use the data gained to improve their company.\u00a0 The problem is that there are just too few experts out there that can turn that mined data into company gold.\u00a0 I\u2019m not surprised, it\u2019s a tough job.\u00a0 Imagine looking at the beach from a helicopter and having to pick out the prettiest seashells. They are all there just waiting for you to grab, but finding it and using it to your advantage is the difficult thing.\u00a0 Some feel analytics software<\/a> is the answer; others feel it\u2019s not how you obtain the data but where you get it from.\u00a0 Applications are becoming a favorite way to pull data from users, with majority of Americans now owning Smartphones or Tablets with internet access.<\/p>\n

When the Sloan Digital Sky Survey started collecting data in the year 2000, it amassed more data in its first few weeks than all the data collected in the history of astronomy (about 200 GB a night, 140 TB in total since 2000).\u00a0 When its successor, the Large Synoptic Survey Telescope takes over in 2016, it will acquire that amount (140TB) every 5 days.\u00a0 In 2010, the Large Hadron Collider produced 13 Petabytes (13,000 Terabytes) of data. My point?\u00a0 Big Data is only going to get bigger, and as time goes on we will have to find ways to better analyze it and sort through it if we want it to be useful.<\/p>\n","protected":false},"excerpt":{"rendered":"

Every day we create 2.5 quintillion bytes of data.\u00a0 90% […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[508],"tags":[884,649,392,885,886,887],"_links":{"self":[{"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/posts\/399"}],"collection":[{"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/comments?post=399"}],"version-history":[{"count":0,"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/posts\/399\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/media?parent=399"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/categories?post=399"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.poly.com\/wp-json\/wp\/v2\/tags?post=399"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}