Skip to main content

The Big 4 Vs of Big Data that you have to consider carefully for a solution ?



Click to image to enlarge.

As you might guess, Integrity Research has interacted with many buy-side investors who either have already started a “big data” initiative or who are considering implementing one in the near-term.  So, what issues should buy-side investors be aware of as they plan to develop a “big data” effort to enhance their current investment research processes?
Volume: Consistent with the term “big data” one of the obvious characteristics of any big data initiative is the volume of data that investors must be prepared to collect and analyze.  As you can see from the slide above, 2.3 trillion gigabytes of data are created every day, with estimates suggesting that 43 trillion gigabytes of data will be created by 2020.  Consequently, buy-side investors looking to develop a big data strategy must be prepared to warehouse and analyze huge amounts of data – considerably more than they have ever worked with in the past.
Velocity: Not only is the volume of data huge, but most big data initiatives require that investors analyze this data in real-time to identify meaningful signals.  Fortunately, most buy-side investors are used to working with real-time data.
Variety: One of the key characteristics of “big data” initiatives is the variety of data types that buy-side investors can collect, including both structured and unstructured data.  A few of the major external data types that we have identified for buy-side clients include data from public sources, social media sites, crowd sourcing efforts, various transaction types, sensors, commercial industry sources, primary research vendors, exchanges and market data vendors.
Veracity: All investors understand the problem of poor data quality when trying to build a reliable research process.  Clearly, this becomes an exponentially more difficult issue for buy-side investors as they try to identify and ingest terabytes of data from numerous public and private sources, all who have different data collection and cleansing processes.  Consequently, investors often have to implement sophisticated data quality checks to make sure that the data they warehouse is reasonably accurate.
Validity: One important concern for buy-side investors when deciding what data they want to acquire and or collect is whether this data is actually useful in helping predict the movement of securities or asset prices.  Warehousing irrelevant data only increases cost and complexity without contributing value to the research process.  Consequently, buy-side investors need to clearly think through the potential validity of a dataset before it is acquired.

Ref http://integrity-research.com/cms/2014/04/

Comments

Post a Comment

Popular posts from this blog

LIC Buys Double as Prices Dive - 10 Aug 2011

http://licreddy.com/Content/information/insurancenews_details.asp?NewsCode=4872 LIC Buys Double as Prices Dive 10-Aug-2011 Life Insurance Corp of India, the government's institution of choice to stabilise the stock market whenever it gets wobbly, has more than doubled stock purchases in the past three days as the global debt worry-triggered selloff made valuations attractive. LIC, the country's biggest investor with stakes in L&T, Axis Bank and Grasim, will raise its secondary market purchases this fiscal as IPOs dry up with promoters not keen to sell shares at lower valuations. "We have been buying in the past few days,'' said a LIC executive involved in decisionmaking. "With the market correcting and not many public issues coming up, we would be investing more in secondary market," said the person who did not want to be identified. LIC to Invest . 50k Cr More LIC, which had been buying stocks for an average of . 120 crore in the first four...
Post a Comment
Read more

Best IELTS and English language training institutions in Hyderabad

IELTS stands for International English Language Testing System. As the name implies it is basically an English test for testing the proficiency of the language in an individual.  Training for IELTS can be taken to pass the IELTS exam or to develop good english language skills. I am giving the training institute addresses for Hyderabad. The test system is jointly managed by the British Council,IDP education ltd and University of Cambridge ESOL Examinations and more than 1 million candidates are taking the exam all over the world. The test has two versions : 1. Academic 2. General training Academic  version is for people who plan to continue their higher education by enrolling in universities in countries like US,UK,Australia,Canada,New Zealand etc.The academic institutions in these countries consider the IELTS score as a criteria for the admission process. General training is mostly for immigration purposes in countries like Australia,New Zealand,Canada etc. It may ...
9 comments
Read more

Home loan or Car loan calculator

A good EMI calculator http://www.bankbazaar.com/home-loan-emi-calculator.html Tax benefits: Tax benefit is only on the interest paid on the loan taken. Prohibition of Usury in Various Religions Hinduism The earliest such record derives from the   Vedic   texts of Ancient India (2,000-1,400 BC) in which the "usurer" ( kusidin ) is mentioned several times and interpreted as any lender at interest.  More frequent and detailed references to interest payment are to be found in the later   Sutra   texts (700-100 BC), as well as the Buddhist   Jatakas   (600-400 BC).  It is during this latter period that the first sentiments of contempt for usury are expressed.  For example, Vasishtha, a well known Hindu law-maker of that time, made a special law which forbade the higher castes of   Brahmanas   (priests) and   Kshatriyas   (warriors) from being usurers or lenders at interest.  Also, in the   J...
3 comments
Read more