Big data as a field is concerned with data that cannot be stored, processed and analyzed by traditional IT-equipment and software. Reasons for this are the data size, the speed in which it can be processed, data heterogeneity and/or the data’s inherent complexity.
To create solutions, big data uses methods from computer science, artificial intelligence, machine learning and statistics, and realizing them requires skills and capabilities in IT, e-infrastructure and programming. The application of big data is generally multidisciplinary and uses knowledge from the application domain and big data, to gain new knowledge and insight.
At NORCE, we are actively carrying out research and development related to many aspects of big data, ranging from the operation of a Hadoop/Spark big data engine, via middleware programming to artificial intelligence, machine learning, and statistics.