Add Stroomprijs for all Dutch providers #17464

enboer · 2024-11-27T15:34:08Z

Add another tariff provider

Ideally I would like to have the enever as a tarif supplier as you do not need support for every single provider. Together with their token you get all Dutch providers. Need to filter them on the the used supplier. I have add their abbreviations.
So as a setting, provide the token and the abbreviation of the supplier. Then EVCC can findout the tariffs.

Price Today
https://enever.nl/api/stroomprijs_vandaag.php?token=YOUR_TOKEN
Price tomorrow
https://enever.nl/api/stroomprijs_morgen.php?token=YOUR_TOKEN

These are the abbr. of the suppliers:

AA = Atoom Alliantie
AIP = All in power
ANWB = ANWB Energie
BE = Budget Energie
EE = EasyEnergy
EN = Eneco
EVO = Energie van Ons
EZ = Energy Zero
FR = Frank Energie
GSL = Groenestroom Lokaal
MDE = Mijndomein Energie
NE = NextEnergy
TI = Tibber
VDB = Vandebron
VON = Vrij op naam
WE = Wout Energie
ZG = ZonderGas
ZP = Zonneplan

This is what you get, for every hour, and the supplier, prijsAA means Atoom Alliantie.

The text was updated successfully, but these errors were encountered:

andig · 2024-11-27T19:58:28Z

Happy to take a pr

andig · 2024-11-29T09:36:38Z

How does one signup for the API? Is there a cost?

tomjschwanke · 2024-11-29T09:41:27Z

seems to only require an email and is limited to private use: https://enever.nl/prijzenfeeds/

andig · 2024-11-29T09:49:31Z

Sehr cool. Wer möchte es versuchen? Es wäre sinnig, das als N Templates je eins pro Provider zu machen.

andig · 2024-11-29T10:57:10Z

I can‘t get data for tomorrow- code 5?

❯ curl https://enever.nl/api/stroomprijs_morgen.php\?token\=2a8e1f19aa60076ea75f00ad94ad569f
{"status":"true","data":[],"code":"5"}%

enboer · 2024-11-29T18:41:06Z

No as a private user not. You have 250 reguest per month. To get the token signup here <https://enever.nl/prijzenfeeds/> Prijzenfeeds<https://enever.nl/prijzenfeeds/> enever.nl<https://enever.nl/prijzenfeeds/> [favicon.ico]<https://enever.nl/prijzenfeeds/> You need one request for today and one for tomorrow. As a supporter you can get 10000 requests. tomorrow prices are available after 15:00 and for sure after 16:00 Regards Erik Nijeboer Op 29 nov 2024 om 10:37 heeft andig ***@***.***> het volgende geschreven: How does one signup for the API? Is there a cost? — Reply to this email directly, view it on GitHub<#17464 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ALIVPVTLBJXXPGE43C2HYAL2DAYT3AVCNFSM6AAAAABSTEEWDCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMBXGQZDKNRUGU>. You are receiving this because you authored the thread.Message ID: ***@***.***>

andig · 2024-11-30T09:06:54Z

The jq part here looks straight forward. I think we'll need to find something that does two HTTP requests. I'll see if we can use #17481 for this purpose.

andig · 2024-12-01T18:02:33Z

Timezone issue resolved thanks to https://stackoverflow.com/questions/79241351/use-jq-to-parse-local-time-into-golang-rfc-3339/79241515#79241515:

tariffs:
  grid:
    type: custom
    forecast:
      source: go
      init: |
        import (
          "fmt"
          "strings"
        )
      script: |
        // concat today and tomorrow
        "[" + strings.Trim(strings.Trim(today, "[]") + "," + strings.Trim(tomorrow, "[]"), ",") + "]"
      in:
        - name: today
          type: string
          config:
            source: http
            uri: https://enever.nl/api/stroomprijs_vandaag.php?token=<token>
            jq: |
              .data | 
              [
                .[] | 
                { 
                  "start": (.datum | strptime("%F %T") | strflocaltime("%FT%T%:z")),
                  "end":   (.datum | strptime("%F %T") | mktime + 3600 | strflocaltime("%FT%T%:z")),
                  "price": (.prijs | tonumber)
                }
              ] | tostring
        - name: tomorrow
          type: string
          config:
            source: http
            uri: https://enever.nl/api/stroomprijs_morgen.php?token=<token>
            jq: |
              .data |
              [
                .[] |
                {
                  "start": (.datum | strptime("%F %T") | strflocaltime("%FT%T%:z")),
                  "end":   (.datum | strptime("%F %T") | mktime + 3600 | strflocaltime("%FT%T%:z")),
                  "price": (.prijs | tonumber)
                }
              ] | tostring

wgentine · 2024-12-01T19:34:40Z

Timezone issue resolved thanks to https://stackoverflow.com/questions/79241351/use-jq-to-parse-local-time-into-golang-rfc-3339/79241515#79241515:

tariffs:
  grid:
    type: custom
    forecast:
      source: go
      script: |
        // concat today and tomorrow
        "[" + strings.Trim(strings.Trim(today, "[]") + "," + strings.Trim(tomorrow, "[]"), ",") + "]"
      in:
        - name: today
          type: string
          config:
            source: http
            uri: https://enever.nl/api/stroomprijs_vandaag.php?token=<token>
            jq: |
              .data | 
              [
                .[] | 
                { 
                  "start": (.datum | strptime("%F %T") | strflocaltime("%FT%T%:z")),
                  "end":   (.datum | strptime("%F %T") | mktime + 3600 | strflocaltime("%FT%T%:z")),
                  "price": (.prijs | tonumber)
                }
              ] | tostring
        - name: tomorrow
          type: string
          config:
            source: http
            uri: https://enever.nl/api/stroomprijs_morgen.php?token=<token>
            jq: |
              .data |
              [
                .[] |
                {
                  "start": (.datum | strptime("%F %T") | strflocaltime("%FT%T%:z")),
                  "end":   (.datum | strptime("%F %T") | mktime + 3600 | strflocaltime("%FT%T%:z")),
                  "price": (.prijs | tonumber)
                }
              ] | tostring

Looks awesome, but I get this issue with your config:
[main ] FATAL 2024/12/01 20:24:19 cannot create tariff type 'custom': forecast: decoding failed due to the following error(s):
'' has invalid keys: init

andig · 2024-12-01T19:48:01Z

Yes, still waiting for another pointer from https://stackoverflow.com/questions/79242253/how-to-use-import-and-return-a-value-in-the-same-eval or traefik/yaegi#1670

wgentine · 2024-12-02T18:31:42Z

Yes, still waiting for another pointer from https://stackoverflow.com/questions/79242253/how-to-use-import-and-return-a-value-in-the-same-eval or traefik/yaegi#1670

Cool! I know nothing about go and have no idea how to integrate with evcc. However, I managed to create a python script with flask that query both APIs every 3 hours (to avoid limit rating) and cache the responses so evcc can call as many times as it wants. Then I created a container and run it there.

I query the python "server"this way, filtering by frankenergie prices only:

tariffs: grid: type: custom forecast: source: http uri: http://192.168.37.12:5000/prices jq: '[.data[] | { "start": ( .datum | strptime("%Y-%m-%d %H:%M:%S") | strftime("%Y-%m-%dT%H:%M:%SZ")), "end": ( .datum | strptime("%Y-%m-%d %H:%M:%S") | mktime + 3600 | strftime("%Y-%m-%dT%H:%M:%SZ")), "price": (.prijsFR | tonumber) }] | tostring'

and the python script here:

`
from flask import Flask, jsonify
import requests
import os
import time

app = Flask(name)

Cache structure

cache = {
'data': None, # To hold the combined data from today and tomorrow
'last_updated': 0, # Timestamp of the last API call
'cache_duration': 60 * 60 * 3 # Cache duration of 3 hours (in seconds)
}

def fetch_and_cache_prices():
"""
Fetches prices from the upstream APIs and caches them.
"""
token = os.getenv('ENERGY_API_TOKEN')
if not token:
return {"error": "API token not provided"}, 400

today_url = f"https://enever.nl/api/stroomprijs_vandaag.php?token={token}"
tomorrow_url = f"https://enever.nl/api/stroomprijs_morgen.php?token={token}"

try:
    # Fetch the data from the upstream URLs
    today_response = requests.get(today_url)
    today_data = today_response.json()

    # Check for error in the API response
    if not today_response.ok or today_data.get("status") != "true":
        return {"error": "Failed to fetch today's prices", "details": today_data}, 502

    tomorrow_response = requests.get(tomorrow_url)
    tomorrow_data = tomorrow_response.json()

    # Check for error in the API response
    if not tomorrow_response.ok or tomorrow_data.get("status") != "true":
        return {"error": "Failed to fetch tomorrow's prices", "details": tomorrow_data}, 502

    # Combine today's and tomorrow's prices
    combined_prices = today_data['data'] + tomorrow_data['data']
    
    # Cache the combined data and update the timestamp
    cache['data'] = combined_prices
    cache['last_updated'] = time.time()  # Update the last updated time to current time
    return combined_prices
except requests.exceptions.RequestException as e:
    return {"error": "An error occurred while fetching data", "details": str(e)}, 500

@app.route('/prices', methods=['GET'])
def get_prices():
"""
Endpoint to get the combined prices, using cached data if available.
"""
current_time = time.time()

# Check if cache is still valid (within the 3-hour window)
if cache['data'] is None or (current_time - cache['last_updated'] > cache['cache_duration']):
    # Cache expired or no data, so fetch new data
    new_data = fetch_and_cache_prices()
    if isinstance(new_data, tuple):  # Check if there's an error response
        return jsonify(new_data[0]), new_data[1]  # Return error response
    return jsonify({"status": "true", "data": new_data, "code": "5"})

# Return cached data if still valid
return jsonify({"status": "true", "data": cache['data'], "code": "5"})

if name == "main":
app.run(host='0.0.0.0', port=5000)`

Not a super elegant solution but it does work and solves the rate limit.

andig added the tariffs Specific tariff support label Nov 27, 2024

This comment was marked as resolved.

Sign in to view

andig changed the title ~~tariffs add~~ Add Stroomprijs for all Dutch providers Nov 29, 2024

This comment was marked as resolved.

Sign in to view

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Stroomprijs for all Dutch providers #17464

Add Stroomprijs for all Dutch providers #17464

enboer commented Nov 27, 2024

andig commented Nov 27, 2024

This comment was marked as resolved.

andig commented Nov 29, 2024

tomjschwanke commented Nov 29, 2024

andig commented Nov 29, 2024

andig commented Nov 29, 2024 •

edited

Loading

enboer commented Nov 29, 2024 via email

andig commented Nov 30, 2024

This comment was marked as resolved.

andig commented Dec 1, 2024 •

edited

Loading

wgentine commented Dec 1, 2024 •

edited by andig

Loading

andig commented Dec 1, 2024 •

edited

Loading

wgentine commented Dec 2, 2024 •

edited

Loading

Add Stroomprijs for all Dutch providers #17464

Add Stroomprijs for all Dutch providers #17464

Comments

enboer commented Nov 27, 2024

andig commented Nov 27, 2024

This comment was marked as resolved.

andig commented Nov 29, 2024

tomjschwanke commented Nov 29, 2024

andig commented Nov 29, 2024

andig commented Nov 29, 2024 • edited Loading

enboer commented Nov 29, 2024 via email

andig commented Nov 30, 2024

This comment was marked as resolved.

andig commented Dec 1, 2024 • edited Loading

wgentine commented Dec 1, 2024 • edited by andig Loading

andig commented Dec 1, 2024 • edited Loading

wgentine commented Dec 2, 2024 • edited Loading

Cache structure

andig commented Nov 29, 2024 •

edited

Loading

andig commented Dec 1, 2024 •

edited

Loading

wgentine commented Dec 1, 2024 •

edited by andig

Loading

andig commented Dec 1, 2024 •

edited

Loading

wgentine commented Dec 2, 2024 •

edited

Loading