Skip to main content

5 Steps to Making your Big Data Useful

Büyük veriyi etkin kullanmak için 5 adım

This is the second in our Big Data series. To read more, see our first article, You got it or not? How to tell if Big Data is something you need to worry about in your application

The promises for big data in manufacturing are tantalizing… improved accuracy and efficiency in your production processes, better forecasting of product demand, quicker, more agile decision making. But realizing these benefits is not as commonplace as you might think, with many mid-market manufacturers collecting data without being able to use it to grow their business or meet their other business goals. How much potentially business-changing data is collecting dust on your servers right now? And how can you begin to use that data?

There are 5 steps to making the most of your big data: 

Step 1. Identify the problem and/or goals

Before you even begin to look at the data, you need understand what problems you have that might be solved with a better understanding of your data. Maybe it’s a material bottleneck, an increase in production time, or an increase in “near-miss” safety incidents. For this post, let’s use an example of a manager at a mid-sized sensor manufacturer who has noticed a higher-than-usual number of gas sensors needing to be serviced lately and wants to know what’s causing the problem. Regardless of your goals, knowing what you’re looking for from the get-go is critical to your big data success. 

Step 2. Ask smart questions

An often overlooked aspect of big data analysis is quality of the inquiries. While many analytical tools can help you spot anomalies in data, you need specific ideas for what to look for. In our sensor example, some specific questions might be:

  • When did the increase in sensors needing service begin?
  • Are any of our other products seeing a higher-than-average return rate?
  • Has an increase like this happened before? When?
  • Is there a correlation between new employees onboarding and broken sensors?
  • Is there a correlation with the weather?

How to make the most of your big data chart

 
Collect as much data & fields as you can to build your cubes. The more granular the cubes are, the more flexible your reporting will be.
 

Step 3. Assess your data

Now is the time to look at what data you currently have, what other data sources you might have access to, and evaluate their accuracy, relevance, and timeliness. In our manufacturing example, available data sources might include their ERP system, suppliers, machines, HR system or outside sources such as weather or social media.

For each source, consider its relevance and based on the 4 V’s - Volume (the amount of data), Variety (its type and structure), Velocity (how quickly the new data is coming in and needing to be used), and Veracity (how accurate or trustworthy the data is).

Step 4. Collect / Ingest:

One key difference between “small” and “big” data has to do with its collection and ingestion. At some point, you hit the limitations of your ERP system’s native reporting functionality – standard ERP reports don’t give you enough flexibility to look at the data the way you need to, the processing of huge reports can slow down performance for the rest of your team, and you can’t incorporate external data sources. The process of ETL (extract, transform, load) allows you to get all data from multiple sources, including your ERP, transform it into a format specifically designed for big queries, then move it into an analysis tool.


PRO TIP: Think big. Collect as much data & fields as you can to build your cubes. The more granular the cubes are, the more flexible your reporting will be. In other words, do not limit yourself to what you want to filter by today, think about what other filters might come in handy tomorrow. Building a cube is very time consuming and can cost a lot of human as well as machine time, this is why preparing a data set as big as you can to begin with will save you time down the road.


abas ERP makes ETL easy with the Unity server, detailed here: https://abas-erp.com/en/news/unity-server

Step 5. Analyze

This is where Business Intelligence (BI) and advanced analytic tools shine with visual representations of complex data sets and other ways to find answers to your question.

These tools can help you account for every piece of your business’s data, and consolidate it to deliver accurate information to decision makers in a timely manner and support effective decision making. This is done by setting specific, measurable goals, coming up with a course of action to work towards them, and finding a means to measure if that course of action is resulting in progress towards those goals. For more on BI in ERP, see this article: https://abas-erp.com/en/news/going-global-business-intelligence-bi

In our example with the sensor manufacturer, our manager is now looking at all of the data in one place. He can see that there have been similar increases in service orders for the gas sensors in the past, and that the increases have typically happened in late March and early April. There doesn’t seem to be any correlation between new employees onboarding and the increase in broken parts, because the new employees are hired throughout the year. The insight comes when the manager looks at the combination of the weather, manufacturing location, and repair dates – the sensors that are breaking seem to be the ones that were manufactured in the company’s cold-climate Canadian warehouses, then shipped to locations in their warm, wet spring seasons. That’s actionable information that he can use to improve their product or distribution processes moving forward, for example, by shipping sensors to warm wet climates from their facility in Mexico, rather than the one in Canada. 

How big is your data?

When analyzing data, what’s the difference between big and small data? The line can get blurred, but you need to make sure that your analytic tools and infrastructure can support the type of data analysis you need to do.

“Small” Data

Big Data

Example

Monthly sales report

Customer Buying Behavior Report

Includes

  • Basic ERP report data such as customers, transactions, dates
  • “Live” data: what’s happening in your system right now, which orders are currently open? What material is coming in tomorrow?
  • Tasks, notes, etc.
  • Thousands or millions of exported ERP records including customers, transactions, dates
  • Data from other relevant sources: IoT data from machines and products; inventory levels from vendors / suppliers, information about buyers such as their role, interests, and detailed purchase history; social media data; temperature or weather information; geographical data, etc.

How to Analyze

  • Single machine
  • Traditional search and analysis tools
  • Distributed architecture
  • Advanced analytical tools

What you can look for

  • Details of individual records
  • Simple trends
  • Complex trends
  • Hard-to-spot relationships between data

Stay tuned for our next topic in the Big Data series: using meta data effectively. 

703-444-2500
+43 1 319 15 19
+49 721 96 72 30
703-444-2500
+38 061 21 37 855
+420 241 931 544
+31 (0)85 3033 555
+421 903 717 980
+55 - 11 5054 - 5500
+852-2793-3317
+91 77559 04373
+62 (21) 293 19 366
+603-56124999
++94 76 666 9070
+66 81 6297375
+359 2 423 61 56

Contact

Your consent can be withdrawn at any time by sending an email to [email protected] . We assure you that we will treat this information as strictly confidential and that it will be used by abas Software GmbH and abas partners only (privacy policy).

North American Headquarters

703-444-2500
abas USA
45999 Center Oak Plaza
Suite 150
Sterling, VA20166

North American Headquarters

703-444-2500
abas USA
45999 Center Oak Plaza
Suite 150
Sterling, VA20166

Infocom Ltd.

+38 061 21 37 855
bul. t. Shevchenko, 56
Zaporozheye
69001

amotIQ sro

+420 241 931 544
Belnická 603
252 42 Jesenice u Prahy

ABAS Business Solutions Nederland BV

+31 (0)85 3033 555
abas Netherlands
Beilerstraat 24
9401 PL Assen

amotIQ sro

+421 903 717 980
amotIQ sro
Palarikova 36
900 28 Ivanka pri Dunaji

SHP Informática Ltda

+55 - 11 5054 - 5500
SHP Informática Ltda
Alameda dos Jurupis, 452, 7°andar - Conjunto 73/74
Sao Paulo - SP 04088-001

abas Business Solutions Limited

+852- 2793-3317
abas Hong Kong
1621, New Tech Plaza
34 Tai Yau Street
Hong Kong

abas Force India Pvt. Ltd.

+91-77559-04373
abas India
303, Aspiro Complex, Opp. Thyssenkrupp,
Pimpri Stn. Road, Pimpri,
Pune 411018

PT. abas Information Systems

+62 (21) 293 19 366
abas Indonesia
11620 Taman Aries, Jakarta barat Jakarta
Grand Aries Niaga G1-2H

Synchro RKK Sdn Bhd

+603-56124999
abas Malaysia
Sunway Geo Avenue,
Jalan Lagoon Selatan
Sunway South Quay,
Bandar Sunway
Subang Jaya Selangor 47500

Providence Global Pvt Limited

+94 770415387
Providence Global Pvt Limited
752/1
Dr De Silva Mawatha
Colombo 09

Wisdom Information Systems

+66-29340451/52/53
Wisdom Information Systems
208/5 Ladprao Soi 126
Bangkok 10310

abas Бизнес Сълюшънс България ООД

+359 2 423 61 56
abas Бизнес Сълюшънс България ООД
жк. Младост 1А, бл.553А, офис 1
1729 София