When integrating metrics ingestion with Statsig, it is not necessary for developers to apply their own date filters within their SQL queries. Statsig is designed to manage date filtering autonomously during the data backfill process.
Upon setting up data ingestion, developers provide a SQL query that generates a view for Statsig to ingest. This query is then utilized by Statsig to incrementally load data on a daily basis. For the purpose of backfilling, Statsig will inspect the data for the past three days from the current date to determine if there has been a significant change, defined as a variation exceeding 5% in the number of rows.
If such a change is detected, Statsig will automatically initiate a backfill. For data outside of this three-day window, it is expected that the developer will manually trigger a backfill for the desired date range. Therefore, the SQL query provided for data ingestion should not be constrained by row limits, as Statsig will handle the necessary date filtering to ensure efficient and accurate data ingestion.