Who is this article for?

Users with questions about their data feeds.

Data feed subscription is required.

Data feeds are large compressed text files containing exports of Ideagen Audit Analytics databases, designed for clients who perform automated analysis, load data into their own systems, or build applications around the data.

1. Should I use data feeds or the online platform?

For most users, the online platform is sufficient. It supports filtering, Excel downloads, and ad hoc analysis without any technical setup. Data feeds are the better choice when you need to:

• Load data into a database or data warehouse
• Automate data processing or analysis
• Build applications on top of the data
• Access all available rows and columns (including large text fields)
• Customise the order and selection of fields

If you are unsure which option is right for your use case, contact Sales for guidance.

2. How are data feeds delivered?

Data feeds are delivered via SFTP (Secure File Transfer Protocol) using key-based authentication from whitelisted IP addresses. Feeds are compressed text files updated daily overnight Eastern time.

When you are set up with data feed access, you will receive a Getting Started with Data Feeds document that covers connection details, file structure, and other onboarding information. For questions about your SFTP connection or access setup, contact us.

3. How do I distinguishing between Standard and Point-in-Time feeds?

Ideagen Audit Analytics offers two types of data feeds:

• Standard feeds are denormalised data feeds. All databases are available as Standard feeds.
• Point-in-Time (PIT) feeds are normalised feeds that include record publish dates indicating when data became available, making them well suited for quantitative modelling and backtesting. PIT feeds began rolling out in 2019, with implementation continuing through 2020 for existing databases. All new feeds created since 2019 include PIT by default.

Your data dictionary will indicate whether your feed is Standard or PIT. For questions about your feed type, contact us.

4. How do I work with supporting feeds?

Supporting feeds are additional data tables included with your main feed subscription at no extra cost. They contain lookup tables, reference data, and additional data points that relate to the main feed.

Each feed's Entity Relationship Diagram (ERD) shows how to join supporting feeds to the main feed using the appropriate key fields. ERDs are included with your data dictionary. If you need a data dictionary or ERD for your feeds, contact us.

5. What is the Company Block feed?

The Company Block is a free feed included for all SEC data feed clients. It contains general company information such as company name, address, and key identifiers, along with financial reporting period fields including:

• LATESTFY - Identifies by end date the latest full fiscal year that has been reported to date.
• LATESTQU - Identifies by end date the latest quarter that has been reported to date.

Separate Company Blocks are also available for Europe, SEDAR (Canada), and Fund data feed clients.

6. What are financial data fields?

Many feeds include an Event Financials Block - a set of financial reporting period fields matched to the relevant event date for that database. These fields allow you to see the company's financial condition at the time of the event being reported.

The Event Financials Block typically includes six reporting period fields:

• PRIORFY / PRIORQU - The latest fiscal year/quarter ending before the event.
• MATCHFY / MATCHQU - The fiscal year/quarter containing the event.
• CLOSESTFY / CLOSESTQU - The fiscal year/quarter closest to the event date, useful when more proximate financials are not available.

Each feed's data dictionary specifies which date is used for event matching (for example, auditor change date, file date) and which financial fields are included. Consult your data dictionary for the specific fields available in your feed.

7. How do I manage feed updates and changes?

Data feeds are updated and delivered daily overnight Eastern time. For questions about delivery schedules, contact us.

When Ideagen Audit Analytics plans changes to your feeds - like adding/removing fields, updating formats, or deprecating feeds - you'll get an email from Product Management with details, timeline, test files, and any required actions.

Non-breaking changes (e.g., new optional fields) may have minimal notice. For changes needing system updates (format changes, field removals), expect 60+ days' notice.

8. How can I respond to feed change notices?

To respond to a change notification:

1. Read the notification carefully.
   identify which feeds are affected, note the timeline, and determine if action is required on your end.
2. Review test files.
   locate them in your feed's test area and run them through your data processing pipeline.
3. Update your systems.
   Modify parsing logic, field references, or add processing for new fields as needed.
4. Confirm readiness.
   Reply to the change notification once testing is complete.
5. Monitor after implementation.
   Check your feeds when the change takes effect and report any issues within 24 hours.

If you need more time, contact the Product Management team to request a timeline extension before the scheduled change date.

9. How do I handle feed deprecation and end of life?

When a feed is being discontinued, you will receive advance notice of the deprecation date, information about replacement feeds if applicable, and an offer to receive a static snapshot of the final data.

After the deprecation date, no new data will be added to that feed. Your data ingestion processes should be updated or disabled accordingly.

If you are affected by a feed deprecation, contact us to confirm whether you need a data snapshot or can discontinue processing.

10. How can I request new fields or feed changes?

To request a new field or other changes:

1. Contact your Account Manager or contact us with the feed name and number and a description of the field or change you need.
2. Wait for the team to evaluate the request and provide test files showing the change in your feed.
3. Validate the test files and confirm you are ready.
4. Confirm with support and they will schedule the production change.

Note

New columns are not added to client feeds automatically. The data feed team requires client approval before adding new fields, to avoid breaking your existing data processing workflows.

If new fields have become available for your database, contact us to request they be added to your feed.

11. Can I customise a feed?

Data feeds are built from a standard generic version for each database. All clients receive the same data structure, file format, and delivery method. Feed content cannot be restructured, reformatted, or delivered in a custom arrangement.

New feed customers receive the generic version of the feed, which includes all available columns and supporting tables. Legacy feed customers may have custom column and supporting table configurations. 

12. What are the differences between website download fields and data feed fields?

The website download and data feeds are separate products with different field availability. Not all fields shown in the website download are available in data feeds, and not all data feed fields appear in the website download. Recreating the website downloads with the data feeds is not possible. 

When mapping your integration, consult your feed-specific data dictionary to confirm which fields are available. If you need a field that exists in one product but not the other, contact us to discuss availability.

13. How can I access data dictionaries and ERDs?

Your data dictionary and Entity Relationship Diagram (ERD) are provided when your feed is set up. Updated versions are sent when structural changes or new fields are added to your feeds. If you need a current copy of either document, contact us.

14. What is the field structure in data dictionaries?

Fields follow standard naming patterns across feeds:

• Company identifiers: COMPANY_FKEY (foreign key linking to Company Block), CIK (SEC Central Index Key), ticker (stock symbol).
• Date fields: Suffixed with _DATE (specific date), _YEAR (fiscal or reporting year), _QTR (quarter), or _FY (fiscal year).
• Flag fields: Prefixed with IS_* or HAS_* and follow a 0/1/2 pattern - 0 = No, 1 = Yes, 2 = Did not disclose. For example, IS_ACCELERATED_FILER and IS_SHELL_COMPANY both use this pattern.
• Financial fields: Prefixed with LATEST* for most recent values - for example, LATESTFY_MARKET_CAP (most recent fiscal year market cap), LATESTQU_MARKET_CAP (most recent quarterly market cap).

Consult your data dictionary for the specific fields available in your feed. The Glossary tab explains how to identify Primary Keys, Business Keys, and Event Dates.

15. How can I report missing or incorrect data?

To report missing or incorrect data:

1. Contact us with the feed name and number (for example, Feed 39, Restatements).
2. Provide specific field name or names affected.
3. Include records affected - company names, CIK numbers, ticker symbols, or record keys.
4. Specify the date range when the issue occurred.
5. For incorrect data, provide the current value in the feed versus the expected value.

Include at least two to three specific examples. Our team will investigate against source systems and provide a resolution. Check your data dictionary first to confirm field name spelling and expected values before reporting.

16. What are NULL or empty values?

NULL values in entity fields typically indicate inactive companies that are no longer filing with the SEC, or records where that data point is not available in the source filing. NULL can also occur when a field is not applicable to certain record types.

Not all optional fields are populated for all records. If you have questions about specific NULL values, contact us with the feed name, field name, and example records.

17. Can I open feed files in Excel?

Data feed files are not designed to be opened in Excel. They are large text files intended to be loaded into a database or data warehouse. Attempting to open them in Excel may cause Excel to crash or result in truncated data.

If you need to review a sample of your feed data without loading it into a database, consider using a text editor or command-line tools to inspect the first few rows of the file.

18. Where can I ask other feed-related questions?

For all data feed questions - including setup, access, field definitions, data dictionaries, feed changes, or technical issues - contact us. When reaching out, include:

• Your feed account name (if you have more than one)
• The feed name and number
• A description of your question or issue