Skip to main content
added 634 characters in body
Source Link

Based on your comments transitioning big data sets from on-premises systems to a cloud-based system is cumbersome and fraught with challenges. However, you can use Amazon RedShift:

Your questionAmazon Redshift is not that clear but still from my experience youa fully managed, petabyte-scale data warehouse service in the cloud. You can do following steps feel freestart with just a few hundred gigabytes of data and scale to comment if you want further explanationa petabyte or more.

  1. The first step is to create a data warehouse is to launch a set of nodes, called an Amazon Redshift cluster.
  2. After you provision your cluster, you can upload your data set and then perform data analysis queries. Regardless of the size of the data set, Amazon Redshift offers fast query performance using the same SQL-based tools and business intelligence applications that you use today.

OR

  1. Use a Hadoop environment as the landing zone to pull in data from various sources, process it, and transfer the processed data to the existing data warehouse or other repositories.
  2. Explore scenarios of different ways to implement a landing zone. Learn about the architecture of the zone and the tools and techniques for integrating it with various environments.

enter image description here

Your question is not that clear but still from my experience you can do following steps feel free to comment if you want further explanation.

  1. Use a Hadoop environment as the landing zone to pull in data from various sources, process it, and transfer the processed data to the existing data warehouse or other repositories.
  2. Explore scenarios of different ways to implement a landing zone. Learn about the architecture of the zone and the tools and techniques for integrating it with various environments.

enter image description here

Based on your comments transitioning big data sets from on-premises systems to a cloud-based system is cumbersome and fraught with challenges. However, you can use Amazon RedShift:

Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. You can start with just a few hundred gigabytes of data and scale to a petabyte or more.

  1. The first step is to create a data warehouse is to launch a set of nodes, called an Amazon Redshift cluster.
  2. After you provision your cluster, you can upload your data set and then perform data analysis queries. Regardless of the size of the data set, Amazon Redshift offers fast query performance using the same SQL-based tools and business intelligence applications that you use today.

OR

  1. Use a Hadoop environment as the landing zone to pull in data from various sources, process it, and transfer the processed data to the existing data warehouse or other repositories.
  2. Explore scenarios of different ways to implement a landing zone. Learn about the architecture of the zone and the tools and techniques for integrating it with various environments.

enter image description here

Source Link

Your question is not that clear but still from my experience you can do following steps feel free to comment if you want further explanation.

  1. Use a Hadoop environment as the landing zone to pull in data from various sources, process it, and transfer the processed data to the existing data warehouse or other repositories.
  2. Explore scenarios of different ways to implement a landing zone. Learn about the architecture of the zone and the tools and techniques for integrating it with various environments.

enter image description here