Challenges with data policy
Hi Kind and helpful friends, our scenario is like this, we have implemented retention policy on our ADLS landing, bronze, and silver layer at the moment. The data we ingested every day is appended data as whole for example today data would be appended…
Azure Data Lake Storage
Data Quality Error Records to Fabric
Hi, I was followed below steps to connect Data quality(Microsoft Purview) to Fabric Onelake for failed records and the connection was successfull. But Failed to "Failed to save storage configuration" error Refer to below documentation, To…
Azure Data Lake Storage
Can you do a walk-through to connect GitHub repos to Fabric?
Have an E3 license with BI Pro. CoPilot indicates connection with GitHub personal account can be done even while in trial on Fabric. The connection is necessary for CI/CD.
Azure Data Lake Storage
Power automate to azure storage
Hello, We are not able to connect using power automate connector to azure storage getting error 403 Authorization failure. This storage account has pvt end point and network setting as selected virtual network. What could be the cause of this issue and…
Azure Data Lake Storage
Data Quality issue in the Purview
Hello Team, We have configured the ADLS2 as source and scan it. For the data Quality, we did the following the steps : Create the Governance domain and publish it. Create the Data Product and add the tables. In the Data Quality section, add the…
Azure Data Lake Storage
Microsoft Security | Microsoft Purview
Azure datalake adls to delta lake
Hi Kind friends and experts, we have a data modernization roadmap, which I have also discussed similar but not exactly the same as this question here in below…
Azure Data Lake Storage
Exporting D365 F&O Data Directly to Azure Data Lake Gen2 Without Dataverse. Questions on Current Approach, Format & Folder Structure
Hi Everyone, I’m currently working on exporting all tables/entities from Dynamics 365 Finance and Operations (Tier 2 environment) directly to Azure Data Lake Gen2. I don’t want to use Dataverse in between. I’ve already created a Storage Account in Azure…
Azure Data Lake Storage
ADLS and optimal solution with historical data
Hi @Anonymous Thank you again for your answer: https://learn.microsoft.com/en-us/answers/questions/5579939/adls-and-optimal-solution My apologies. I missed an important and critical factor : ERP data in ADLS has data since 2016 but the Azure data…
Azure Data Lake Storage
Not able to access the ADLS storage account via Microsoft Purview scanning
I have created an SPN and stored secretes under the KV "abcd". I am trying to Scan the Storage account 'stkordnadlsprod01' from Purview . but I am getting below errors. Request failed with status code 403 Request ID:…
Azure Data Lake Storage
ADLS and optimal solution
Hi Kind friends, the scenario I am currently in , and I have made lots of deliberations but I need your expert guidance. We have a database that is currently moved and hosted in Azure managed instance(MI) , and we have an ERP tool which is already…
Azure Data Lake Storage
Request for Guidance on Enabling Managed Identity for Blob Storage Access with HNS Requirement
As part of our IT Security compliance and audit requirements, we are aligning with Microsoft’s recommendation to use Azure Active Directory (Azure AD) for authorizing access to Azure Storage accounts, instead of using Shared Key authorization. Azure AD…
Azure Data Lake Storage
partition the csv files creating log files
I am partitioning the csv files and storing in azure data lake. The destination contains:- _committed_138917450370135985 _started_138917450370135985 _SUCCESS part-00000-tid-138917450370135985-822eee2b-508b-46ea-9ed6-c426f350d05c-223-1-c000.csv I only…
Azure Data Lake Storage
Azure Databricks
How to know how much storage you have in Dataverse
I am building a website through PowerPages that allows users to upload their files. However, I am not sure if there is any storage limit, rate limit, etc. How can I check on those details
Azure Data Lake Storage
Upgrade to a storage account with Azure Data Lake Gen2 capabilities is temporarily disabled
Hi, I would like to upgrade a Storage Account with Data Lake Gen2 capabilities (hierarchical namespace). When I'm trying to do it from Azure console UI, I'm getting the message: "Upgrade to a storage account with Azure Data Lake Gen2 capabilities is…
Azure Data Lake Storage
adls static data sources
Hi friends, Thank you to the experts @Anonymous and @Anonymous for the direction and kind help. https://learn.microsoft.com/en-us/answers/questions/5532358/adls-structure-approach …
Azure Data Lake Storage
Storage options and solution
Hi kind friends, as we are moving data views from virtualization tool to Azure, we are left with two options in data landing, create these views in Synapse dedicated pool and data would reside in table within Synapse, another option is follow the current…
Azure Data Lake Storage
ADLS data incoporation with other data source
Hi friends, we have an ERP data in ADLS and we have come up with KPIs on that dataset, but business want KPIs that consist of ERP and legacy application data which has data since that legacy database host data since 1985 hence it want KPIs that enlist…
Azure Data Lake Storage
ADLS structure approach
Hi friends, we are getting data from API endpoint , and saving the data in Parquet file format, since it is Parquet file format ,I have designed Data Lake hierarchical order in the form ,ADLS hierarchy for landing zone,bronze, silver layer now, for…
Azure Data Lake Storage
How to change Blob Inventory files daily generation time
In my Azure Data Lake Storage Gen2 storage account, I have a Blob Inventory rule to generate files daily: I want the files to be generated at the end of the day (9PM), since I have another scheduled process that consumes the generated data at 10PM every…
Azure Data Lake Storage
[URGENT] Accidental Deletion of Azure Data Lake Storage Gen2 Account – Can Data Be Restored?
Hello Microsoft Support Team, I am reaching out regarding an accidental deletion of our Azure Data Lake Storage Gen2 account. The storage account was deployed inside the Resource Group rg-x-production, which I unintentionally deleted. After the deletion,…