Generating monthly summaries of data, data that starts in middle of month will have no graph

[tomatensaus]

I am trying to generate monthly graphs using a running total of data that gets reset on a daily basis.

The graph does not show unless the recording starts at the 1st of the month. Is there any way to render data even though the month is incomplete. Below is an example where there is plenty data for November (last month) but the data started recording after the 1st.

This is the data

This data is also recorded as a full total that increases every day with no resets. If this makes it easier to use, then I would switch the graph to use this data. just mentioning it in case this makes the problem easier to solve

type: custom:plotly-graph
entities:
  - entity: sensor.deyeinvertermaster_summary_day_pv
    statistic: sum
    name: |
      $fn ({ ys,meta }) =>
        "Solar" + "🔆"
    period: month
    type: bar
    texttemplate: '%{y}'
    extend_to_present: true
    width: $fn() => 1000*60*60*24*6
    offset: $fn() => 1000*60*60*24*1
    filters:
      - delta
    marker:
      color: rgb(255, 155, 48)
  - entity: sensor.deyeinvertermaster_summary_day_load
    statistic: sum
    name: |
      $fn ({ ys,meta }) =>
        "Load" + "⚡"
    period: month
    type: bar
    width: $fn() => 1000*60*60*24*6
    offset: $fn() => 1000*60*60*24*8
    extend_to_present: true
    filters:
      - delta
    texttemplate: '%{y}'
    marker:
      color: rgb(95, 182, 173)
  - entity: sensor.deyeinvertermaster_summary_day_grid_importbuy
    statistic: sum
    name: |
      $fn ({ ys,meta }) =>
        "Grid Import" + "💡"
    period: month
    type: bar
    texttemplate: '%{y}'
    width: $fn() => 1000*60*60*24*6
    offset: $fn() => 1000*60*60*24*15
    extend_to_present: true
    filters:
      - delta
    marker:
      color: rgb(84, 144, 194)
  - entity: sensor.deyeinvertermaster_summary_day_battery_discharge
    statistic: sum
    name: |
      $fn ({ ys,meta }) =>
        "Battery Discharge" + "🖱️"
    period: month
    type: bar
    texttemplate: '%{y}'
    width: $fn() => 1000*60*60*24*6
    offset: $fn() => 1000*60*60*24*22
    extend_to_present: true
    filters:
      - delta
    marker:
      color: rgb(151, 90, 182)
  - entity: sensor.deyeinvertermaster_summary_day_battery_charge
    statistic: sum
    name: |
      $fn ({ ys,meta }) =>
        "Battery Charge" + "🔋"
    period: month
    type: bar
    texttemplate: '%{y}'
    extend_to_present: true
    width: $fn() => 1000*60*60*24*6
    offset: $fn() => 1000*60*60*24*29
    filters:
      - delta
    marker:
      color: yellow
hours_to_show: 6M
title: Monthly Production
refresh_interval: 600
defaults:
  yaxes:
    fixedrange: true
layout:
  legend:
    bgcolor: rgba(0,0,0,0)
    itemsizing: constant
    font:
      size: 11
  height: 410
config:
  displayModeBar: false
  scrollZoom: false
time_offset: 1M

I was hoping that the extend to present would fix that scenario.
I need a way to present the data even though it is not complete

[dbuezas]

Can you double check with the stock statistics card that the data is indeed available?

[tomatensaus]

Sure, here is the data according to stock statistics, data started recording 9Nov. The first couple of days the daily summary summary also resets around 23:10 to 0 (as the date time on the inverter was also incorrect)

[tomatensaus]

The total PV with no resets and increasing (Scale is just MWh)

[dbuezas]

Oh, I think I misread your intent. The monthly data is indeed missing in home assistant for those months and you want to use finer granularity data to reconstuct those missing months, right?
In that case you could use filters: use the derivative, filter out negative values, then integrate with reset

[tomatensaus]

No I am not trying to reconstruct any data. Just use and report on the recorded data available

Let me paint my usecase:

Home assistant started monitoring on 9 November and recording data.
If data from 1-8Nov is missing the monthly graph does not display anything (this is true for remainder of November). See first graph not showing for November.

I still want the total displayed for 9-30Nov, it might not be complete but it is really annoying to have to wait 20 days before seeing a monthly summary.

On 1 Dec, the totals for Dec start showing(even though December is missing data from 2-31 Dec) . Nothing for November.

How do I apply a filter that would calculate the totals from the available data, skipping the 1-8 Nov

[dbuezas]

Yes that's what I understood. You need a second trace using daily data (instead of monthly, which has missing months) and then either add it by hand, or use the trick above. You'll likely need JavaScript, give chat gpt a try! :)

[tomatensaus]

I wasted several hours trying to understand how data gets returned by logging it and how the graphing expects it to look. ChatGPT could not generate anything useful. Perhaps it was my questions were lacking.

I do not know enough javascript. Gave up on this issue. For anyone else searching here. Sorry!