Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Service Data Integration with MLW Template #405

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

mahhanifi
Copy link
Contributor

@mahhanifi mahhanifi commented Aug 10, 2020

All Submissions:


  • [YES] Have you followed the guidelines in our Contributing document?
  • [YES] Have you added an explanation of what your changes do and why you'd like us to include them?
  • [YES] I have updated the documentation accordingly.
  • [YES] I have added tests to cover my changes.
  • [YES] All new and existing tests passed.
  • [YES] My code follows the code style of this project.
  • [YES] I ran lint checks locally prior to submission.
  • [YES] Have you checked to ensure there aren't other open Pull Requests for the same update/change?

What is the current behavior?


Issue Number: N/A

What is the new behavior?


  • New template is added to the templates folder that performs the data integration using ml module
  • The SQL dataset/linked is removed as it was very specific to this use case and we wanted to have adf module as general as we can

Does this introduce a breaking change?


  • [NO]

Any relevant logs, error output, etc?


(If it’s long, please paste to https://ghostbin.com/ and insert the link here.)

Other information


@mahhanifi mahhanifi changed the title Mahanifi/new template WIP - Mahanifi/new template Aug 11, 2020
@mahhanifi mahhanifi changed the title WIP - Mahanifi/new template WIP - Azure Service Data Integration with MLW Template Aug 18, 2020
ran the terraform recursive and fixed it

changed the cares name into sample

Add adf and fix AF to use id
@helayoty
Copy link
Contributor

helayoty commented Aug 26, 2020

@TechnicallyWilliams @nmiodice Ready for review!

@mahhanifi mahhanifi changed the title WIP - Azure Service Data Integration with MLW Template Azure Service Data Integration with MLW Template Aug 26, 2020
@TechnicallyWilliams
Copy link
Contributor

ML is out of my area of expertise but I gave it a good one over. Templates along with tests present no red flags.

@@ -0,0 +1,139 @@
# Azure Application Services

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this README correct? Looks the same as some of the app service environments but I don't see reference to any data factory integration in the document

source = "../../modules/providers/azure/service-plan"
resource_group_name = azurerm_resource_group.app_rg.name
service_plan_name = local.func_app_sp_name
# scaling_rules = var.scaling_rules

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this is not needed it can be removed, along with any referenced variables that are not necessary.

@@ -0,0 +1,114 @@
# output "fqdns" {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove any commented code

role_scopes = local.rbac_contributor_scopes
}

# resource "azurerm_role_assignment" "aks_acr_pull" {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ditto

sql_collections = local.cosmos_sql_collections
}

# //storage for ADF data prep

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ditto

TfOptions: tfOptions,
ExpectedTfOutputCount: 21,
TfOutputAssertions: []integration.TerraformOutputValidation{
//verifyAppServiceConfig,

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove this commented section


func appendKeyVaultTests(t *testing.T, description unit.ResourceDescription) {
kvBasicExpectations(t, description)
//kvAccessPolicyExpectations(t, description)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ditto

"module.app_insights.azurerm_application_insights.appinsights": expectedAppInsights,
}

//appendAutoScaleTests(t, resourceDescription)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ditto

@@ -68,34 +68,4 @@ variable "data_factory_trigger_frequency" {
description = "The trigger freqency. Valid values include Minute, Hour, Day, Week, Month. Defaults to Minute."
type = string
default = "Minute"
}

variable "data_factory_dataset_sql_name" {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like the interface to this module is changing. Why? Is that needed for this PR?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants