Skip to content

Moved DBSetup to persistence #10

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
SolidArcSoftware merged 1 commit into from
Jul 1, 2026
Merged

Moved DBSetup to persistence #10

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
64 changes: 64 additions & 0 deletions DataArc.EntityFrameworkCore.Demo.Persistence/DemoDatabaseInitializer.cs
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
using Microsoft.Extensions.DependencyInjection;

using DataArc.EntityFrameworkCore.Demo.Persistence.Database.Creator;
using DataArc.EntityFrameworkCore.Demo.Persistence.Database.Seeder;
using Microsoft.EntityFrameworkCore.Storage;

namespace DataArc.EntityFrameworkCore.Demo.Persistence
{
public static class DemoDatabaseInitializer
{
private const int BatchSize = 100_000;

public static async Task InitializeAsync(IServiceProvider serviceProvider)
{
var databaseCreators = new IDatabaseCreator[]
{
serviceProvider.GetRequiredService<IFinanceDbCreator>(),
serviceProvider.GetRequiredService<IHrDbCreator>(),
serviceProvider.GetRequiredService<IItDbCreator>(),
serviceProvider.GetRequiredService<IOperationsDbCreator>()
};

var databaseSeeders = new IDatabaseSeeder[]
{
serviceProvider.GetRequiredService<IHrDbSeeder>()
};

await ResetDatabasesAsync(
databaseCreators,
databaseSeeders,
BatchSize);
}

private static async Task ResetDatabasesAsync(
IReadOnlyCollection<IDatabaseCreator> databaseCreators,
IReadOnlyCollection<IDatabaseSeeder> databaseSeeders,
int batchSize)
{
foreach (var databaseCreator in databaseCreators)
{
if (!databaseCreator.EnsureDeleted())
throw new InvalidOperationException($"Failed to delete database using {databaseCreator.GetType().Name}.");
}

Console.WriteLine("Databases deleted successfully.");

foreach (var databaseCreator in databaseCreators)
{
if (!databaseCreator.EnsureCreated())
throw new InvalidOperationException($"Failed to create database using {databaseCreator.GetType().Name}.");
}

Console.WriteLine("Databases created successfully.");

foreach (var databaseSeeder in databaseSeeders)
{
if (!await databaseSeeder.SeedDatabaseAsync(batchSize))
throw new InvalidOperationException("Failed to seed the demo databases.");
}

Console.WriteLine("Databases seeded successfully.");
}
}
}
58 changes: 5 additions & 53 deletions DataArc.EntityFrameworkCore.Demo/Program.cs
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,20 +1,17 @@
using Microsoft.EntityFrameworkCore.Storage;
using Microsoft.Extensions.Configuration;
using Microsoft.Extensions.DependencyInjection;
using Microsoft.Extensions.Hosting;

using DataArc.EntityFrameworkCore.Demo.Application.Modules.Finance.Registration;
using DataArc.EntityFrameworkCore.Demo.Application.Workers;
using DataArc.EntityFrameworkCore.Demo.Persistence.Database.Creator;
using DataArc.EntityFrameworkCore.Demo.Persistence.Database.Seeder;
using Microsoft.Extensions.Configuration;

const int batchSize = 100_000;
using DataArc.EntityFrameworkCore.Demo.Persistence;

var host = Host
.CreateDefaultBuilder(args)
.ConfigureServices(services =>
{
var configurationManager = new ConfigurationManager();

configurationManager
.AddJsonFile("appsettings.json", optional: false)
.Build();
Expand All @@ -26,54 +23,9 @@
.Build();

using var scope = host.Services.CreateScope();

var databaseCreators = new IDatabaseCreator[]
{
scope.ServiceProvider.GetRequiredService<IFinanceDbCreator>(),
scope.ServiceProvider.GetRequiredService<IHrDbCreator>(),
scope.ServiceProvider.GetRequiredService<IItDbCreator>(),
scope.ServiceProvider.GetRequiredService<IOperationsDbCreator>()
};

var databaseSeeders = new IDatabaseSeeder[]
{
scope.ServiceProvider.GetRequiredService<IHrDbSeeder>()
};

await ResetDatabasesAsync(databaseCreators, databaseSeeders, batchSize);

await DemoDatabaseInitializer.InitializeAsync(scope.ServiceProvider);
await host.RunAsync();

Console.WriteLine();
Console.WriteLine("Press any key to exit.");
Console.ReadKey();

static async Task ResetDatabasesAsync(
IReadOnlyCollection<IDatabaseCreator> databaseCreators,
IReadOnlyCollection<IDatabaseSeeder> databaseSeeders,
int batchSize)
{
foreach (var databaseCreator in databaseCreators)
{
if (!databaseCreator.EnsureDeleted())
throw new InvalidOperationException($"Failed to delete database using {databaseCreator.GetType().Name}.");
}

Console.WriteLine("Databases deleted successfully.");

foreach (var databaseCreator in databaseCreators)
{
if (!databaseCreator.EnsureCreated())
throw new InvalidOperationException($"Failed to create database using {databaseCreator.GetType().Name}.");
}

Console.WriteLine("Databases created successfully.");

foreach (var databaseSeeder in databaseSeeders)
{
if (!await databaseSeeder.SeedDatabaseAsync(batchSize))
throw new InvalidOperationException("Failed to seed the demo databases.");
}

Console.WriteLine("Databases seeded successfully.");
}
Console.ReadKey();
69 changes: 43 additions & 26 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -70,9 +70,9 @@ Total inserted records = RecordCount x 4

| Method | Record Count Per Context | Total Inserted Records | Mean | StdDev | Completed Work Items | Lock Contentions | Gen0 | Allocated |
|---|---:|---:|---:|---:|---:|---:|---:|---:|
| ExecuteParallelBulkInsertAsync | 62,500 | 250,000 | 486.2 ms | 30.92 ms | 19,193 | - | 5,000 | 60.77 MB |
| ExecuteParallelBulkInsertAsync | 125,000 | 500,000 | 887.7 ms | 159.61 ms | 38,051 | - | 10,000 | 120.93 MB |
| ExecuteParallelBulkInsertAsync | 250,000 | 1,000,000 | 1,747.1 ms | 285.75 ms | 77,796 | - | 20,000 | 242.21 MB |
| ExecuteParallelBulkInsertAsync | 62,500 | 250,000 | 543.5 ms | 43.35 ms | 19,109 | - | 5,000 | 60.73 MB |
| ExecuteParallelBulkInsertAsync | 125,000 | 500,000 | 793.7 ms | 123.56 ms | 38,686 | - | 10,000 | 121.25 MB |
| ExecuteParallelBulkInsertAsync | 250,000 | 1,000,000 | 1,879.3 ms | 194.56 ms | 77,531 | - | 20,000 | 242.11 MB |

These results are workload-specific evidence, not a universal performance guarantee. Hardware, SQL Server configuration, schema shape, indexes, batch size, runtime version, and database state all affect results.

Expand Down Expand Up @@ -172,52 +172,68 @@ flowchart LR

The demo uses the .NET generic host.

`Program.cs` configures services, prepares the demo databases, and starts the host. The hosted worker runs the actual data workflow.
`Program.cs` configures the generic host, registers the hosted worker, initializes the demo databases, and starts the host. The hosted worker runs the actual data workflow.

```text
Program.cs = host setup + demo database preparation
Program.cs = host setup + startup flow
DemoDatabaseInitializer = demo database reset, create, and seed
DemoWorkflowWorker = background data workflow runner
SalaryAdjustmentService = read-transform-write workflow
EmployeePerformanceService = cross-context read model
Persistence = EF Core contexts, contracts, registration, seeding, and database creators
Persistence = EF Core contracts, contexts, registration, database creation, seeding, and initialization
```

This shape is familiar to .NET developers because many real data workflows run as background jobs, scheduled workers, import/export processors, reconciliation jobs, reporting projection builders, or internal batch processes.

```csharp
const int batchSize = 100_000;

var host = Host
.CreateDefaultBuilder(args)
.ConfigureServices((context, services) =>
.ConfigureServices(services =>
{
var configurationManager = new ConfigurationManager();

configurationManager
.AddJsonFile("appsettings.json", optional: false)
.Build();

services
.AddFinanceModule(context.Configuration)
.AddFinanceModule(configurationManager)
.AddHostedService<DemoWorkflowWorker>();
})
.Build();

using var scope = host.Services.CreateScope();

var databaseCreators = new IDatabaseCreator[]
{
scope.ServiceProvider.GetRequiredService<IFinanceDbCreator>(),
scope.ServiceProvider.GetRequiredService<IHrDbCreator>(),
scope.ServiceProvider.GetRequiredService<IItDbCreator>(),
scope.ServiceProvider.GetRequiredService<IOperationsDbCreator>()
};
await DemoDatabaseInitializer.InitializeAsync(scope.ServiceProvider);

var databaseSeeders = new IDatabaseSeeder[]
{
scope.ServiceProvider.GetRequiredService<IHrDbSeeder>()
};
await host.RunAsync();

await ResetDatabasesAsync(databaseCreators, databaseSeeders, batchSize);
Console.WriteLine();
Console.WriteLine("Press any key to exit.");
Console.ReadKey();
```

await host.RunAsync();
The database setup detail belongs in persistence. The workflow execution detail belongs inside the worker and use-case services, not in `Program.cs`.

---

## Demo Database Initialization

`DemoDatabaseInitializer` lives in the persistence project because database reset, creation, script generation, and seeding are persistence setup concerns.

`Program.cs` decides when the demo initialization runs. The persistence project owns how it runs.

The initializer coordinates the individual database creators and seeders:

```text
FinanceDbCreator
HrDbCreator
ItDbCreator
OperationsDbCreator
HrDbSeeder
```

The repetitive bulk-operation detail belongs inside the use-case service, not in `Program.cs`.
Keeping the creators separate makes the setup easier to read, easier to test, and easier to troubleshoot. The more advanced database builder composition is still available, although this demo introduces database creation one database at a time for lower-friction adoption.

---

Expand Down Expand Up @@ -608,6 +624,7 @@ DataArc.EntityFrameworkCore.Demo
│ └── DemoWorkflowWorker.cs
│
├── Persistence
│ ├── DemoDatabaseInitializer.cs
│ ├── Contracts
│ │ ├── IFinanceDbContext.cs
│ │ ├── IHrDbContext.cs
Expand Down Expand Up @@ -756,15 +773,15 @@ xychart-beta
title "Parallel bulk insert mean time"
x-axis ["250k", "500k", "1M"]
y-axis "Mean time in ms" 0 --> 2000
bar [486.2, 887.7, 1747.1]
bar [543.5, 793.7, 1879.3]
```

```mermaid
xychart-beta
title "Managed memory allocated per operation"
x-axis ["250k", "500k", "1M"]
y-axis "Allocated MB" 0 --> 260
bar [60.77, 120.93, 242.21]
bar [60.73, 121.25, 242.11]
```

---
Expand Down
Loading