Skip to main content

The Big 4 Vs of Big Data that you have to consider carefully for a solution ?



Click to image to enlarge.

As you might guess, Integrity Research has interacted with many buy-side investors who either have already started a “big data” initiative or who are considering implementing one in the near-term.  So, what issues should buy-side investors be aware of as they plan to develop a “big data” effort to enhance their current investment research processes?
Volume: Consistent with the term “big data” one of the obvious characteristics of any big data initiative is the volume of data that investors must be prepared to collect and analyze.  As you can see from the slide above, 2.3 trillion gigabytes of data are created every day, with estimates suggesting that 43 trillion gigabytes of data will be created by 2020.  Consequently, buy-side investors looking to develop a big data strategy must be prepared to warehouse and analyze huge amounts of data – considerably more than they have ever worked with in the past.
Velocity: Not only is the volume of data huge, but most big data initiatives require that investors analyze this data in real-time to identify meaningful signals.  Fortunately, most buy-side investors are used to working with real-time data.
Variety: One of the key characteristics of “big data” initiatives is the variety of data types that buy-side investors can collect, including both structured and unstructured data.  A few of the major external data types that we have identified for buy-side clients include data from public sources, social media sites, crowd sourcing efforts, various transaction types, sensors, commercial industry sources, primary research vendors, exchanges and market data vendors.
Veracity: All investors understand the problem of poor data quality when trying to build a reliable research process.  Clearly, this becomes an exponentially more difficult issue for buy-side investors as they try to identify and ingest terabytes of data from numerous public and private sources, all who have different data collection and cleansing processes.  Consequently, investors often have to implement sophisticated data quality checks to make sure that the data they warehouse is reasonably accurate.
Validity: One important concern for buy-side investors when deciding what data they want to acquire and or collect is whether this data is actually useful in helping predict the movement of securities or asset prices.  Warehousing irrelevant data only increases cost and complexity without contributing value to the research process.  Consequently, buy-side investors need to clearly think through the potential validity of a dataset before it is acquired.

Ref http://integrity-research.com/cms/2014/04/

Comments

Post a Comment

Popular posts from this blog

Communist party launches 'China Operating System' to oust iOS and Android

hina officials have launched a national operating system in an attempt to take back control of the country’s computer market from American companies such as Google and Apple. The software has been in development for more than a year, but has been released at a crucial time with revelations about US-led surveillance sparking fears over the integrity of American-designed software. Known simply as the China Operating System, or COS, the software can run on PCs, tablets and smartphones and has been based on the open-source Linux operating system. Chinese media say that the OS has been created “entirely independently” in order to provide better localization for a range of features – from Chinese-language keyboards, to integration with the country’s banks. At the launch of the event, one of the developers involved with the project reportedly criticized Western software , saying that Apple’s iOS was too closed, that Google’s Android OS suffered from fragmentation (ie, too many versi
Post a Comment
Read more

Best IELTS and English language training institutions in Hyderabad

IELTS stands for International English Language Testing System. As the name implies it is basically an English test for testing the proficiency of the language in an individual.  Training for IELTS can be taken to pass the IELTS exam or to develop good english language skills. I am giving the training institute addresses for Hyderabad. The test system is jointly managed by the British Council,IDP education ltd and University of Cambridge ESOL Examinations and more than 1 million candidates are taking the exam all over the world. The test has two versions : 1. Academic 2. General training Academic  version is for people who plan to continue their higher education by enrolling in universities in countries like US,UK,Australia,Canada,New Zealand etc.The academic institutions in these countries consider the IELTS score as a criteria for the admission process. General training is mostly for immigration purposes in countries like Australia,New Zealand,Canada etc. It may also be u
9 comments
Read more

How to avoid injurious sitting posture at work? Take care of Ergonomics

The impact of poor consideration of these, as well as other, ergonomic elements can be very hazardous to our  well-being. Some of the effects include increase chances of suffering from carpel tunnel syndrome, decreased eye sight, cramps in our joints, strain from overworking certain muscles and joints,  and decreased blood-flow circulation. Work productivity also decreases when we are in environments that are not designed for proper ergonomics. One other important thing to consider is the lighting levels in the space. I actually did not even think of this as an ergonomic design issue, but it truly is.  Our eye muscles are the most used muscles in our entire body.  We use our eyes in every situation throughout our entire day.  Poor considerations for lighting causes very negative short and long-term effects.  It is recommended that we use mixed levels of lighting in our environments. This allows for multiple options for each user depending on his or her preferences and physical nee
Post a Comment
Read more