Explore Azure Database and Analytics Services

    

Due to a developing wide variety of acquisitions over the past decade, Tailwind Traders use diverse database and analytics technologies. As the employer starts emigrate present facts workloads and install new facts workloads to Azure, it wishes to recognize which Azure generation could be suitable for every workload. The employer's Chief Technology Officer (CTO) has assigned you the challenge of learning the unique database alternatives which are available. This studies will assist your employer pick the proper alternatives for every of your facts scenarios.

Learning objectives

    After finishing this module, you will be capable of describe the blessings and utilization of:

• Azure Cosmos DB
• Azure SQL Database
• Azure SQL Managed Instance
• Azure Database for MySQL
• Azure Database for PostgreSQL
• Azure Synapse Analytics
• Azure HDInsight
• Azure Databricks
• Azure Data Lake Analytics

Prerequisites

• You need to be acquainted with simple computing ideas and terminology.
• You need to be acquainted with simple database ideas and terminology.

Explore Azure Cosmos DB

    Over the years, Tailwind Traders has obtained numerous smaller corporations. Each of those corporations had groups of builders who used one-of-a-kind database offerings and diverse APIs to paintings with their records. A long-time period plan is probably to sooner or later flow all the disparate records to a not unusualplace database service. For now, though, you want to permit every of those groups to paintings with an surroundings wherein they could use their present skills. Fortunately for you, Azure Cosmos DB can assist out.

    Azure Cosmos DB is a globally distributed, multi-version database provider. You can elastically and independently scale throughput and garage throughout any wide variety of Azure areas worldwide. You can take benefit of fast, single-digit-millisecond information get entry to with the aid of using the use of someone of numerous famous APIs. Azure Cosmos DB gives complete provider degree agreements for throughput, latency, availability, and consistency guarantees.

    Azure Cosmos DB helps schema-much less information, which helps you to construct fantastically responsive and "Always On" programs to assist continuously converting information. You can use this option to shop information this is up to date and maintained with the aid of using customers across the world.

    For example, Tailwind Traders gives a public schooling portal this is utilized by clients throughout the globe to find out about the unique equipment that Tailwind Traders creates. Tailwind Traders builders preserve and replace the information. The following instance indicates a pattern Azure Cosmos DB database this is used to shop information for the Tailwind Traders schooling portal website.

    

    Azure Cosmos DB is flexible. At the bottom degree, Azure Cosmos DB shops records in atom-record-sequence (ARS) format. The records is then abstracted and projected as an API, that you specify whilst you are developing your database. Your picks encompass SQL, MongoDB, Cassandra, Tables, and Gremlin. This degree of flexibleness approach that as you migrate your company's databases to Azure Cosmos DB, your builders can stay with the API that they are the maximum cushty with.

Explore Azure SQL Database

    Azure SQL Database is a relational database primarily based totally at the modern solid model of the Microsoft SQL Server database engine. SQL Database is a high-performance, reliable, completely managed, and steady database. You can use it to construct data-pushed packages and web sites withinside the programming language of your choice, while not having to manipulate infrastructure.

Features

    Azure SQL Database is a platform as a provider (PaaS) database engine. It handles maximum of the database control functions, which includes upgrading, patching, backups, and monitoring, with out person involvement. SQL Database affords ninety nine.ninety nine percentage availability. PaaS competencies which are constructed into SQL Database permit you to cognizance at the domain-particular database management and optimization sports which are crucial to your business. SQL Database is a completely controlled provider that has integrated excessive availability, backups, and different not unusualplace upkeep operations. Microsoft handles all updates to the SQL and working device code. You do not should manipulate the underlying infrastructure.

    You can create a tremendously to be had and excessive-overall performance records garage layer for the packages and answers in Azure. SQL Database may be the proper desire for a number of present day cloud packages as it permits you to manner each relational records and non-relational structures, which includes graphs, JSON, spatial, and XML.

    You can use superior question processing features, which includes excessive-overall performance, in-reminiscence technology and shrewd question processing. In fact, the most modern competencies of SQL Server are launched first to SQL Database, after which to SQL Server itself. You get the most modern SQL Server competencies, and not using a overhead for updates or upgrades, examined throughout tens of thousands and thousands of databases.

Migration

    Tailwind Traders presently makes use of numerous on-premises servers strolling SQL Server, which give facts garage on your public-dealing with internet site (for example, patron facts, order history, and product catalogs). In addition, your on-premises servers strolling SQL Server additionally offer facts garage on your internal-most effective schooling portal internet site. Tailwind Traders makes use of the internet site for brand new worker schooling materials (together with observe materials, certification details, and schooling transcripts). The following example indicates the varieties of facts that your agency may shop withinside the Azure SQL Database schooling portal internet site.

    You can migrate your present SQL Server databases with minimum downtime through the use of the Azure Database Migration Service. The Microsoft Data Migration Assistant can generate evaluation reviews that offer suggestions to assist manual you thru required modifications previous to appearing a migration. After you examine and remedy any remediation required, you are prepared to start the migration process. The Azure Database Migration Service plays all the required steps. You simply alternate the relationship string for your apps.

Explore Azure database for MySQL

    Tailwind Traders presently manages numerous web sites on-premises that use the LAMP stack (Linux, Apache, MySQL, PHP). As a part of your making plans on your migration strategy, the exclusive groups at Tailwind Traders were discovering the to be had carrier services that Azure offers. You've already located that the Web Apps characteristic of Azure App Service offers integrated capability to create net packages that use PHP on a Linux server walking Apache. You've been tasked with investigating whether or not the database necessities for the net improvement crew will stay met after the migration to Azure.

    Azure Database for MySQL is a relational database provider withinside the cloud, and it is primarily based totally at the MySQL Community Edition database engine, variations 5.6, 5.7, and 8.0. With it, you've got got a ninety nine.ninety nine percentage availability provider degree settlement from Azure, powered with the aid of using a worldwide community of Microsoft-controlled datacenters. This allows preserve your app walking 24/7. With each Azure Database for MySQL server, you're taking benefit of integrated security, fault tolerance, and statistics safety which you might in any other case have to shop for or design, build, and manage. With Azure Database for MySQL, you could use point-in-time repair to get better a server to an in advance state, as a ways again as 35 days.

Azure Database for MySQL delivers:

• Built-in high availability with no additional cost.
• Predictable performance and inclusive, pay-as-you-go pricing.
• Scale as needed, within seconds.
• Ability to protect sensitive data at-rest and in-motion.
• Automatic backups.
• Enterprise-grade security and compliance.

    These abilities require nearly no administration, and all are furnished at no extra cost. They let you awareness on speedy app improvement and accelerating your time-to-market, in place of having to manipulate digital machines and infrastructure. In addition, you could migrate your present MySQL databases with minimum downtime via way of means of the usage of the Azure Database Migration Service. After you've got got finished your migration, you could preserve to increase your software with the open-supply equipment and platform of your choice. You do not must analyze new skills.

    Azure Database for MySQL gives numerous provider tiers, and every tier presents special overall performance and talents to aid light-weight to heavyweight database workloads. You can construct your first app on a small database for some greenbacks a month, after which regulate the size to satisfy the desires of your solution. Dynamic scalability allows your database to transparently reply to swiftly converting aid requirements. You handiest pay for the sources you want, and handiest whilst you want them.

Explore Azure Database for PostgreSQL

    As a part of its ordinary information strategy, Tailwind Traders were the usage of PostgreSQL for numerous years. You and your group possibly already realize the advantages of PostgreSQL. Part of your migration is to apply Azure Database for PostgreSQL, and also you need to ensure that you may have get right of entry to to the identical advantages as your on-premises server earlier than transferring to the cloud.

Azure Database for PostgreSQL is a relational database carrier withinside the cloud. The server software program is primarily based totally at the network model of the open-supply PostgreSQL database engine. Your familiarity with equipment and understanding with PostgreSQL is relevant whilst you are the use of Azure Database for PostgreSQL.

Moreover, Azure Database for PostgreSQL offers the subsequent benefits:

• Built-in excessive availability as compared to on-premises resources. There's no extra configuration, replication, or price required to ensure your packages are usually available.
• Simple and bendy pricing. You have predictable overall performance primarily based totally on a particular pricing tier desire that consists of software program patching, computerized backups, monitoring, and protection.
• Scale up or down as needed, inside seconds. You can scale compute or garage independently as needed, to ensure you adapt your carrier to in shape usage.
• Adjustable computerized backups and point-in-time-repair for as much as 35 days.
• Enterprise-grade protection and compliance to guard touchy statistics at-relaxation and in-motion. This protection covers statistics encryption on disk and SSL encryption among consumer and server communication.

Azure Database for PostgreSQL is to be had in  deployment options: Single Server and Hyperscale (Citus).

Singel Server

The Single Server deployment option delivers:

• Built-in high availability with no additional cost (99.99 percent SLA).
• Predictable performance and inclusive, pay-as-you-go pricing.
• Vertical scale as needed, within seconds.
• Monitoring and alerting to assess your server.
• Enterprise-grade security and compliance.
• Ability to protect sensitive data at-rest and in-motion.
• Automatic backups and point-in-time-restore for up to 35 days.

All the ones skills require nearly no administration, and all are furnished at no extra cost. You can attention on fast software improvement and accelerating a while to market, in place of having to manipulate digital machines and infrastructure. You can hold to expand your software with the open-supply gear and platform of your choice, while not having to examine new skills.

The Single Server deployment alternative gives 3 pricing tiers: Basic, General Purpose, and Memory Optimized. Each tier gives one of a kind aid skills to assist your database workloads. You can construct your first app on a small database for some greenbacks a month, after which alter the size to satisfy the desires of your solution. Dynamic scalability allows your database to transparently reply to unexpectedly converting aid requirements. You best pay for the assets you want, and best while you want them.

Hyperscale (Citus)

    The Hyperscale (Citus) choice horizontally scales queries throughout a couple of machines through the usage of sharding. Its question engine parallelizes incoming SQL queries throughout those servers for quicker responses on big datasets. It serves packages that require extra scale and performance, commonly workloads which are approaching, or already exceed, one hundred GB of data.

    The Hyperscale (Citus) deployment choice helps multi-tenant packages, real-time operational analytics, and excessive throughput transactional workloads. Applications constructed for PostgreSQL can run allotted queries on Hyperscale (Citus) with fashionable connection libraries and minimum changes.

Explore Azure SQL Managed Instance

    Azure SQL Managed Instance is a scalable cloud facts provider that offers the broadest SQL Server database engine compatibility with all of the advantages of a totally controlled platform as a provider. Depending in your scenario, Azure SQL Managed Instance may provide extra alternatives to your database needs.

Features

    Like Azure SQL Database, Azure SQL Managed Instance is a platform as a carrier (PaaS) database engine, this means that that your organization can be capable of take gain of the first-rate functions of shifting your information to the cloud in a fully-controlled environment. For example, your organization will not want to buy and manipulate high priced hardware, and also you might not should hold the extra overhead of coping with your on-premises infrastructure. On the alternative hand, your organization will enjoy the short provisioning and carrier scaling functions of Azure, collectively with computerized patching and model upgrades. In addition, you will be capable of relaxation confident that your information will continually be there while you want it via integrated excessive availability functions and a 99.99% uptime carrier stage agreement (SLA). You'll additionally be capable of shield your information with computerized backups and a configurable backup retention period.

    Azure SQL Database and Azure SQL Managed Instance provide most of the identical functions; however, Azure SQL Managed Instance offers numerous alternatives that won't be to be had to Azure SQL Database. For example, Tailwind Traders presently makes use of numerous on-premises servers going for walks SQL Server, and that they would really like emigrate their current databases to a SQL database going for walks withinside the cloud. However, numerous in their databases use Cyrillic characters for collation. In this scenario, Tailwind Traders ought to migrate their databases to an Azure SQL Managed Instance, considering Azure SQL Database best makes use of the default SQL_Latin1_General_CP1_CI_AS server collation.

Migration

    Azure SQL Managed Instance makes it smooth emigrate your on-premises facts on SQL Server to the cloud the usage of the Azure Database Migration Service (DMS) or local backup and restore. After you've got got found all the functions that your employer uses, you want to evaluate which on-premises SQL Server times you could migrate to Azure SQL Managed Instance to peer when you have any blockading issues. Once you've got got resolved any issues, you could migrate your facts, then cutover out of your on-premises SQL Server for your Azure SQL Managed Instance through converting the relationship string on your applications.

   

Explore big data and analytics

    Several years ago, Tailwind Traders rolled out a brand new GPS monitoring gadget for all of its transport vehicles. The new gadget gives real-time monitoring statistics on your number one datacenter. Your CTO wishes your group to have a take a observe numerous years of monitoring statistics with a view to decide trends. For example, an vital fashion is probably a spike in deliveries across the vacations that might require hiring extra staff. Through an in-intensity evaluation of the monitoring statistics that you have recorded, your CTO seeks to are expecting whilst adjustments are important, after which proactively take the important steps to accurately control spikes.

    Data is available in all styles of bureaucracy and formats. When we speak approximately huge statistics, we are relating to huge volumes of statistics. In this Tailwind Traders scenario, statistics is accumulated from the GPS sensors, which incorporates vicinity information, statistics from climate systems, and lots of different reassets that generate huge quantities of statistics. This quantity of statistics turns into an increasing number of tough to make feel of and to base selections on. The volumes are so huge that conventional styles of processing and evaluation are now not appropriate.

    Open-supply cluster technology had been developed, over time, to attempt to cope with those huge datasets. Microsoft Azure helps a wide variety of technology and offerings to offer huge statistics and analytic solutions, together with Azure Synapse Analytics, Azure HDInsight, Azure Databricks, and Azure Data Lake Analytics.

Azure Synapse Analytics

    Azure Synapse Analytics (previously Azure SQL Data Warehouse) is a infinite analytics provider that brings collectively employer facts warehousing and large facts analytics. You can question facts for your phrases with the aid of using the use of both serverless or provisioned sources at scale. You have a unified enjoy to ingest, prepare, manage, and serve facts for instant enterprise intelligence and system gaining knowledge of needs.

Azure HDInsight

    Azure HDInsight is a totally managed, open-supply analytics carrier for enterprises. It's a cloud carrier that makes it easier, faster, and extra cost-powerful to system huge quantities of information. You can run famous open-supply frameworks and create cluster kinds which includes Apache Spark, Apache Hadoop, Apache Kafka, Apache HBase, Apache Storm, and Machine Learning Services. HDInsight additionally helps a vast variety of eventualities which includes extraction, transformation, and loading (ETL), information warehousing, device learning, and IoT.

Azure Databricks

    Azure Databricks facilitates you liberate insights from all of your statistics and construct synthetic intelligence solutions. You can installation your Apache Spark surroundings in minutes, after which autoscale and collaborate on shared tasks in an interactive workspace. Azure Databricks helps Python, Scala, R, Java, and SQL, in addition to statistics technological know-how frameworks and libraries along with TensorFlow, PyTorch, and scikit-learn.

Azure Data Lake Analytics

    Azure Data Lake Analytics is an on-call for analytics process provider that simplifies large statistics. Instead of deploying, configuring, and tuning hardware, you write queries to convert your statistics and extract precious insights. The analytics provider can manage jobs of any scale right away via way of means of placing the dial for a way a great deal strength you need. You most effective pay to your process whilst it is running, making it extra cost-effective.