Dear Research Survey Participant:

Data integration is the linchpin that enables all types of users — from advanced data scientists and analysts to those working with self-service business intelligence (BI) — to get the data they urgently need. However, this makes data integration a pressure point: Users need faster data flows, better performance, higher data volumes, and higher quality. Plus, there have never been as many users as there are today — users who depend on data integration to make strategic decisions, innovate with analytics, and manage daily operations.

Purpose: In this survey, we ask for your expertise and opinions about current data integration trends. We will report the results back to the community to help business and IT professionals understand what the most challenging issues are and how to solve them. Just as workload requirements are changing, so are data integration alternatives. Cloud platforms, real-time data streaming, ELT, and integrated data warehouses and data lakes are among them.

Who should take the survey? We invite a range of individuals to take this survey, which is geared to professionals in both business and IT who need to integrate, blend, stream, and collect data. This includes chief data and analytics officers, data scientists and analysts, business analysts, and those who head up BI, data warehousing, and data lake management. Consultants taking the survey should answer questions with their most recent clients in mind.

Directions: This survey has 20 questions, including two demographics questions at the end. It should take about 10 minutes. As you answer the questions, please press the "ok" button where it appears after questions and then "done" at the end of the survey to ensure recording of your answers. By enabling cookies for your browser, you can leave the survey and return to finish it later if you prefer. TDWI will keep the survey live until March 23, 2021.

Please let me know if you have any difficulties in taking this survey. Thank you for your important participation!

Sincerely,

David Stodder
Senior Director, TDWI Research, Business Intelligence
dstodder@tdwi.org

Question Title

* 1. Which of the following best describes your personal experience with data integration technology and tools, including data warehouses and data lakes? (Please select the most appropriate answer.)

Question Title

* 2. Which of the following data management platforms are currently in use by your organization? (Please check all that apply.)

Question Title

* 3. Approximately what percentage of your organization’s data management for BI and analytics is currently on cloud platforms?

Question Title

* 4. Which company is the primary cloud provider platform that your organization uses for data management to support BI and analytics? (Please select the primary one or fill in "other.")

Question Title

* 5. In the next 12 months, to what degree will your organization increase or decrease the percentage of its data management in the cloud?

Question Title

* 6. How significant a driver is growth in the number of users doing analytics, as well as the data they require, in accelerating your organization’s adoption of cloud data management? (Please select the most appropriate answer.)

Question Title

* 7. Which of the following best represents your opinion about having a single data architecture that unifies a data warehouse and a data lake? (Please select the most appropriate answer.)

Question Title

* 8. What is your primary data integration approach or most common approaches? (Please select up to three.)

Question Title

* 9. How difficult is it for users in your organization to utilize data from the following sources for analytics?

  Very difficult Somewhat difficult Not too difficult Not at all difficult Don't know/NA
Mainframe/legacy applications
On-premises business applications (e.g., SAP, Oracle)
Software as a service (SaaS) applications
File-based sources
IoT/data streaming systems
Cloud data storage or data lake
On-premises data warehouse
Cloud data warehouse
Spreadsheets
Social media sources (e.g., Facebook, Slack, Twitter)
Other media (e.g., images, video, audio)

Question Title

* 10. What is the current average data refresh rate for BI and analytics in your organization? (Please select the most appropriate answer.)

Question Title

* 11. How satisfied are users in your organization with the current average data refresh rate for the following types of BI and analytics?

  Very satisfied Somewhat satisfied Somewhat dissatisfied Not very satisfied Don't know/NA
Operational BI dashboards
Enterprise BI query and reporting
Self-service business analytics
Data exploration and discovery
Alerts and notifications
Creating & managing OLAP cubes
Predictive analytics modeling
AI/machine learning
Data science projects
Mobile BI and analytics
Embedded BI/analytics in business applications

Question Title

* 12. How much time does it commonly take to add new data sources to your BI/analytics platform?

Question Title

* 13. In the last 12 months, has it been taking more time, about the same amount of time, or less time to add new data sources to your BI/analytics platform?

Question Title

* 14. How do your data consumers get new data sets? (Please select the most common practice.)

Question Title

* 15. How long does it routinely take data consumers to get a new data set?

Question Title

* 16. How significant of a hindrance are the following data integration issues to your organization’s success with BI and analytics?

  Very significant Somewhat significant Not significant Don't know/NA
Significant time and effort required to provide access to new data sources
Takes too long to add new data to an existing data warehouse
Users cannot find the data they need
Users don’t have confidence in the quality and cleanliness of the data
IT cannot keep up with business user requests for data
Data integration tasks require too much manual coding; there is not enough automation
Data is not refreshed fast enough

Question Title

* 17. Please select the “truth value” of each of the following statements regarding your organization.

  Very true Somewhat true Not true Don't know/NA
Our data lake is more of a science experiment
Our data lake is basically a data swamp
Our data warehouse is where data goes to die
Most data integration is still done via spreadsheets (e.g., Microsoft Excel)
We are moving analytics to the cloud, but most or all the same on-premises challenges remain
By the time our data integration request has been fulfilled, the business has moved on to other priorities

Question Title

* 18. Which of the following business objectives would be easier to achieve if your organization improved its data integration processes and technologies?

Question Title

* 20. How many people work in your organization?

Thank you for participating in this TDWI research study. Stay tuned for our Webinar broadcast on May 27, 2021 to hear analysis of the results!

T