Skip to main content

The Big 4 Vs of Big Data that you have to consider carefully for a solution ?



Click to image to enlarge.

As you might guess, Integrity Research has interacted with many buy-side investors who either have already started a “big data” initiative or who are considering implementing one in the near-term.  So, what issues should buy-side investors be aware of as they plan to develop a “big data” effort to enhance their current investment research processes?
Volume: Consistent with the term “big data” one of the obvious characteristics of any big data initiative is the volume of data that investors must be prepared to collect and analyze.  As you can see from the slide above, 2.3 trillion gigabytes of data are created every day, with estimates suggesting that 43 trillion gigabytes of data will be created by 2020.  Consequently, buy-side investors looking to develop a big data strategy must be prepared to warehouse and analyze huge amounts of data – considerably more than they have ever worked with in the past.
Velocity: Not only is the volume of data huge, but most big data initiatives require that investors analyze this data in real-time to identify meaningful signals.  Fortunately, most buy-side investors are used to working with real-time data.
Variety: One of the key characteristics of “big data” initiatives is the variety of data types that buy-side investors can collect, including both structured and unstructured data.  A few of the major external data types that we have identified for buy-side clients include data from public sources, social media sites, crowd sourcing efforts, various transaction types, sensors, commercial industry sources, primary research vendors, exchanges and market data vendors.
Veracity: All investors understand the problem of poor data quality when trying to build a reliable research process.  Clearly, this becomes an exponentially more difficult issue for buy-side investors as they try to identify and ingest terabytes of data from numerous public and private sources, all who have different data collection and cleansing processes.  Consequently, investors often have to implement sophisticated data quality checks to make sure that the data they warehouse is reasonably accurate.
Validity: One important concern for buy-side investors when deciding what data they want to acquire and or collect is whether this data is actually useful in helping predict the movement of securities or asset prices.  Warehousing irrelevant data only increases cost and complexity without contributing value to the research process.  Consequently, buy-side investors need to clearly think through the potential validity of a dataset before it is acquired.

Ref http://integrity-research.com/cms/2014/04/

Comments

Post a Comment

Popular posts from this blog

Best IELTS and English language training institutions in Hyderabad

IELTS stands for International English Language Testing System. As the name implies it is basically an English test for testing the proficiency of the language in an individual.  Training for IELTS can be taken to pass the IELTS exam or to develop good english language skills. I am giving the training institute addresses for Hyderabad. The test system is jointly managed by the British Council,IDP education ltd and University of Cambridge ESOL Examinations and more than 1 million candidates are taking the exam all over the world. The test has two versions : 1. Academic 2. General training Academic  version is for people who plan to continue their higher education by enrolling in universities in countries like US,UK,Australia,Canada,New Zealand etc.The academic institutions in these countries consider the IELTS score as a criteria for the admission process. General training is mostly for immigration purposes in countries like Australia,New Zealand,Canada etc. It may ...
9 comments
Read more

Communist party launches 'China Operating System' to oust iOS and Android

hina officials have launched a national operating system in an attempt to take back control of the country’s computer market from American companies such as Google and Apple. The software has been in development for more than a year, but has been released at a crucial time with revelations about US-led surveillance sparking fears over the integrity of American-designed software. Known simply as the China Operating System, or COS, the software can run on PCs, tablets and smartphones and has been based on the open-source Linux operating system. Chinese media say that the OS has been created “entirely independently” in order to provide better localization for a range of features – from Chinese-language keyboards, to integration with the country’s banks. At the launch of the event, one of the developers involved with the project reportedly criticized Western software , saying that Apple’s iOS was too closed, that Google’s Android OS suffered from fragmentation (ie, too many versi...
Post a Comment
Read more

How to use home loans most effectively for tax benefits

1) Deduction on interest: If you are paying EMIs for a home loan you took to buy a house, the interest component in the EMI can be claimed as deduction. You must be both an owner and a co-borrower (in the loan) to claim tax benefits. This deduction can be claimed starting the year in which the construction of the house is completed. Suppose the construction of your house was completed on August 30, 2014, you can claim deduction for interest for the entire 12 months in financial year 2014-15. So every year a maximum of Rs. 2 lakh can be claimed for a house that you use for your own residence. If your house is rented, the entire interest for the year can be claimed as deduction. The interest payments for the year shall result in a loss under the head 'income from house property'. This loss can be adjusted against in the same year against other heads of income in your income tax return including salary. Therefore, it reduces your total taxable income and the tax you pay thereon. A...
2 comments
Read more