Workflow

SQL-Hub setup consists of a few simple steps...

Setting up the Central Database

• To hold configuration information and the merged data

Connecting to a Source

• To gather information about the structure of the source databases

Building the Central Tables

• To create the table structure for the central copies of the chosen tables. This only needs to be done once - but can be revisited at any point

Adding Further Sources

• To connect to each of the source databases - only the connection parameters are required, no additional configuration

Synchronisation

• To merge the data from all of the source databases

The Result:

• A Central Database with a copy of the chosen tables containing the data from all of the source databases

Setting up the Central Database

• Open SQL-Hub
• Configure the Central Database Connection:

Enter the paramaters as follows

• Click Connect:

SQL-Hub will connect to the Central Server

If the connection is not successful any errors will be shown in the progress panel.

Once the connection is made, an asterisk icon will appear.

• Click on the asterisk to create the Central Database.

Once the above is complete you should be able to see this database in MySQL and you now need to connect a source database to complete the set up.

• Click Add New Source

Now configure the first source

Connecting a Source

• Click Add New Source
• Configure the Source Connection:

Enter the paramaters as follows

• Click Connect:

SQL-Hub will connect to the Source Server

If the connection is not successful any errors will be shown in the errors panel.

If the Table List has not yet been created, that is the next step, if it has already been created you can proceed directly to synchronization.

• Click Create Table List:

You can now select the tables you want to include in your merged central database

Check the box next to each table you would like to include if this is your first time configuring a merged central view you might want to just select one or two tables to try out. You can change the table selection later by clicking Update Table List.

• Click Ok

Creating the central tables

SQL-Hub will display a message detailing the current status

• Click Create Master Tables

  to create empty copies of the data tables in the merged central database

If you have not used SQL-Hub before you will need to get a FREE licence to create the master tables. To get a licence, click the Get Licence button on the licence panel, top right.

Getting a Licence

• Click on the "Get Licence" button in the Licence panel.

  If you cannot see the Licence panel, click on the spanner icon.

• You will be directed to the SQL-Hub website. Follow the instructions on the website

Copy and paste the code into the SQL-Hub Licence panel and click Apply.

Remember to click Create Master Tables again once you have your new licence.

Note: Some anti-virus systems (e.g. Webroot) may block the paste action on the SQL-Hub application - if you have this problem set SQL-Hub to "allow" under "Identity Protection" - feel free to switch it back to deny once you've pasted in your licence code

You are now ready to synchronise from this source

• Click Synch

Permissioning Dynamics

1. Login to dynamics in an account with admin permissions
2. Go to Settings > Customizations > Developer Resource and get the Instance Web API Service Root URL remove everything after the .com for [API Url]
3. Go to admin.microsoft.com from “Admin” under the apps blob on the top left
4. Go to Azure Active Directory (show all) on the left
5. Select Azure Active directory on the left
6. Click App Registrations in the mid left menu
7. Click New Registration
   
   1. Enter a name
   2. Click Register
8. Get the client ID - Application (client) ID [Client ID]
9. Click endpoints (top middle) and get the OAuth 2.0 authorization endpoint (v1) [Login End Point]
10. Click API Permissions (on the mid left menu)
    
    1. Click Add a permission
    2. Select Dynamics CRM – Delegated Permissions – user_impersonation
    3. Click Add Permission
    4. Click “Grant admin consent for ….”
11. Click Authentication in the mid left menu
    
    1. Switch on Default Client Type (as this mechanism uses Resource owner password credential)
12. In SQL Hub select the password (Azure Delegated Pemissions) grant type and fill out using the parameters [above] and your username and password
13. You can also connect to On Prem via password auth and via Application Permissions via Client Credentials but this will need to be set up by the it provider

Synchronising

SQL-Hub allows you to synchronise in 3 ways...

On Demand Instance Synchronisation

Synchronise from a single source database from the user interface.

• Click Synch on the panel relating to a specific source.

On Demand Full Synchronisation

Synchronise from all source databases from the user interface.

• Click the Synch All icon on the Master Connection panel.

Scheduled Full Synchronisation

Synchronise from all source databases from the command line automatically. See Scheduling Below

The Synchronisation Process

The synchonisation process creates a database on the central server for each instance database and creates a table in the Central database for each table included.

Data is copied from each source database to a central copy and then inserted in the merged central database table by table. The progress and any errors are displayed.

Once the process is complete you will find tables in the Central Database containing data from all of the synchronised databases and tables.

Scheduling

You can schedule full synchronisation using the Windows Task Scheduler

When running through the UI SQL-Hub stores connection settings in the current user profile - the same user must be used for the scheduler to allow these connection settings to be determined

• Open the Schedule panel, below the Licence panel
• Click "Create Task"

SQL-Hub will automatically create a task to synchronise all sources daily.

You can edit the task using Windows Task Scheduler to suit your requirements. Just find the task in the Windows Task Scheduler Library and adjust the settings.

Your SQL-Hub setup is now complete

You now have everything in place to maintain a central database containing all the data from your source databases

As we say in Manchester, Job's a good 'un