Hello rain purple,
Thank you for reaching out to the Microsoft Q&A forum.
Here’s what you can consider doing to address this:
Understand the Costs:
- The Azure Machine Learning managed virtual network is generally free, but you incur charges for Azure Private Link (which includes private endpoints) and potentially Azure Firewall if you have FQDN based rules set up.
- You mentioned that your costs surged with a 25% increase, mainly from Private Link costs. The Private Link allows secure communication, but it can ramp up costs based on usage.
Check Your Private Endpoints:
- If you do not need the private endpoints for your current operations, consider temporarily deleting them. However, keep in mind that deleting Azure Machine Learning resources like workspaces or endpoints may affect the configurations and previously stored settings.
Managing Your Virtual Network:
- If you find that a certain resource (like the machine learning workspace) is costing more than anticipated and not in use, deleting and potentially recreating it later could result in cost savings.
- Be cautious that deleting the workspace may lose all configurations and settings tied to your Machine Learning operations, such as AKS setups or priority instances.
Firewall and Subnet Configuration:
- You mentioned issues with local IP and firewall subnet limits. Ensure your network setup aligns with Azure's requirements to not incur unnecessary charges.
- If Firewall fees aren’t showing in the cost file, check if you're indeed configuring the firewall rules properly or if other services might inadvertently lead to costs.
To identify more specific issues and optimize your setup, here are some follow-up questions that might help clarify:
Costs:
- Can you provide a breakdown of your costs related to the Private Link and Firewall, or if there are specific resources you suspect are generating the higher charges?
Resource Usage:
- Are the resources such as the workspace and private endpoints actively being used, or are they in a standby state?
- When you checked the Azure Copilot, did the numbers reflect variable usage patterns over different periods?
Impact of Deleting Resources:
- Have you considered how the dependencies between your Machine Learning settings and the private endpoints might affect existing projects if deleted?
- Will you need to maintain persistent configurations, or can they be easily recreated/validated post-deletion?
Configuration:
- Do you have a detailed inventory of all the resources you are using within the virtual network? Understanding what you have can help optimize costs.
Hope this helps you sort through the cost issues and manage your setup more effectively! Let me know if there's anything else you might need!
References:
- Azure Machine Learning Managed Network Isolation
- Azure Firewall pricing
- Azure Private Link pricing
- Secure Azure Machine Learning Workspace Resources by Using Virtual Networks