Troubleshooting Processing Financial Data
In order to process historical data, you must have financial reports in the storage location your billing source is configured to pull from and that data must be in the correct format. While processing data, if data for a selected month is missing or unreadable, that month will be skipped and we will move on to the next.
Identifying Processing Failures and Errors
When a month is skipped during processing, it means we tried and failed to process that month 3 times in a row.
To identify failures and errors, you can check the Kion logs:
- In Kion, navigate to Settings > System Diagnostics.
- Ensure the Financials Poller's log level is set to Info. If this was not previously set to info, you will need to reprocess your financial data again to gather the logs.
- Sign in to the AWS console using the account where Kion is installed.
- Navigate to CloudWatch.
- Click Logs Insights.
- Select Kion-Logs (or cloudtamer-logs) as the log group.
- To see which months have failed to process, filter by:
{ $.level = "info" && $.msg= %Skipping% } - To see the error messages for skipped months, filter by:
{ $.level = "error" && $.msg= %Process Month% }
Common Processing Errors
Billing data is missing
If this is the case, use the methods under Identifying how far Back your Financial Data Goes to ensure historical data for that month exists in your storage location.
For information on configuring billing report storage for Kion to access, see What is a Billing Source?
Billing data is in the wrong format
If this is the case, ensure the financial reports in your storage location are the format Kion is configured to look for.
To check this, navigate to Accounts > Billing Sources. Click the ellipsis menu next to your billing source and select Edit. Look at which Billing Report Type is selected. This is the billing report that needs to be in your storage location.
For information on configuring billing report storage for Kion to access, see What is a Billing Source?
Connection errors
If this is the case, retry the process at a later time.
To retry processing your data, navigate to System Settings > Financial Settings > Default Spend Settings > Reprocess Historical Spend Data.
Identifying how far Back your Financial Data Goes
If you have multiple billing accounts, you will need to check each separately using one of the following methods.
In Kion
- Log in to Kion.
- Navigate to Accounts > Billing Sources.
- Click the ellipsis menu next to your billing source, and select Edit.
- Under AWS Linked Role, click Test Billing Connection.
The Oldest Cost and Usage Report date is the earliest financial data report that Kion can access in the storage location associated with your billing source.
In the AWS Console
- Log in to the AWS Console using your management account.
-
Search for and select
billing. - Select Cost & usage reports.
- Select the S3 bucket where your reports are stored.
-
Filter by
report. - Select the report/ prefix.
- Click the report name.
The oldest report listed is the earliest financial data report that Kion can access in this storage location.
If you have multiple Azure billing sources, you will need to check each separately using the following.
- Log in to the Azure Console.
- Navigate to Cost Management + Billing > Cost Management.
- From the menu on the left, click Exports.
- In the list of exports that appears, click on the name of the export you use for Kion. This may be named Kion billing export.
- On the summary page that appears, note the Storage container and Storage directory for this export. Locate the Storage account field and click on the value of this field. You will be taken to this storage account.
- From the menu on the left, select Storage browser.
- Select Blob containers.
- From the list of folders that appears, navigate to the path you identified previously for your export. This was named Storage directory on the export summary page.
- Within the folder containing the billing export, you will see a number of folders named for date ranges. Click the Name heading to sort this folder in ascending order with the oldest first.
The oldest report listed is the earliest financial data report that Kion can access in this storage location.
If you have multiple billing accounts, you will need to check each separately using the following method.
- Log in to the Google Cloud Console.
- Navigate to Billing.
- Navigate to Billing Export.
- Under Detailed Usage Cost, click the dataset name.
- Expand the options under the dataset, and select the entry that starts with gcp_billing_export_resource.
- Select the Details tab.
The oldest report listed is the earliest financial data report that Kion can access in this storage location.