Read data from Smart Meter using P1 USB cable

---

Hello,

I want to read out data from my Smart Meter with a P1 Usb cable.
I got data when running this command:

cu -l /dev/ttyUSB0 -s 9600 --parity=none

Does anyone here already working to display counters from the data captured?
@incmve said to me to use de log-reader, but i am very new to pimatic.

So how to I capture the data from TTYusb0 to the database without massive grow of database?
And then how to proces it to display counters in pimatic of usage and total usage and stuff?

If this is the wrong forum… sorry

Grtz Rob

Hi Rob!

I’m doing such a similar thing, it looks like this here :

Here at the first section you can see the pimatic logreader plugin in action, the “Photovoltaik Energiemonitor”. The logfile from my photovoltaic inverter is created by a cronjob that uses a program called sbfspot. Then I grep it and use the logreader plugin to create this device. The device shows the actual production of 24Watt, a daily production of 2,7 KW and an overall production of 14144 KW.
On the right side you can see the ping plugin that is watching the photovoltaic inverter. I also created a rule to send me a pushover message when the inverter has no LAN connection anymore : "IF SMA inverter is offline THEN push title:“SMA inverter is offline” message:“The photovoltaics inverter is offline. Please check immediately!” priority:1
Below the SMA ping plugin you can see the Sunrise/Sunset time for the actual day. This is also a logreader device, created from a logfile also from the pv-inverter. It’s of no special use, just for information, since i use sunrise or sunset in rules for my shutter devices to control my blinds (another page but not that interesting I think

The next section is the “Energiezähler”. Here I’m using the pimatic volkszaehler-plugin to gather information from my energy meters in the basement. I’m having another pi down there which has IR-D0 USB devices connected to read-out the energy meters directly. These information are stored at the database from the software called “Volkszaehler” (http://www.volkszaehler.org). From there I am getting the values with the volkszaehler-plugin into pimatic. The values “Stromverbrauch24h” andEigenverbrauch24h" are the total energy consumption counted from 0.oo o’clock for 24h then) and the energy that we consumed from the produced energy for ourselfs. what’s missing is the total infeed for this day. I will add it later.
Those both values are calculated by two rules, some variables that i created and to visualize i used the variables device.

Well, that’s my setup.

What energy meter do you have and how does your datafile look like? can you post it? If the data is in clear text and not hex, I would suggest to create a cron job to read your energy meter every 15 minutes (or closer) and create a logfile. Then use the pimatic logreader to parse the logfile for the energy data.
This should do it.

Very nice

The data from my meter is:

/KMP5 KA6U001584708311

0-0:96.1.1(204B413655303031353834373038333131)
1-0:1.8.1(09865.000kWh)
1-0:1.8.2(11011.000kWh)
1-0:2.8.1(00000.000kWh)
1-0:2.8.2(00000.000kWh)
0-0:96.14.0(0001)
1-0:1.7.0(0000.61kW)
1-0:2.7.0(0000.00kW)
0-0:17.0.0(999*A)
0-0:96.3.10(1)
0-0:96.13.1()
0-0:96.13.0()
0-1:24.1.0(3)
0-1:96.1.0(3238313031353431303033303435303131)
0-1:24.3.0(150214150000)(00)(60)(1)(0-1:24.2.1)(m3)
(02848.614)
0-1:24.4.0(1)

Nobody written a native pimatic script yet? Or idea’s of doing it?

@Rob-Jager Would be nice if some1 could make a plugin. The p1 usb cable isn’t that expensive. Meanwhile it should be readable with the pimatic logreader.

a pimatic plugin is not necessary in my opinion. the logreader plugin is able to parse these logs and separate the needed data into a variable.

so what you need are these two outputs (for both tariffs i guess) into a variable at pimatic
1-0:1.8.1(09865.000kWh)
1-0:1.8.2(11011.000kWh)

for that you will need a proper matchcode (finally i made it!)

the logreader device looks like this (but you can customize it for your own purpose) :

{
  "id": "energymeter",
  "name": "Robs Energy Meter",
  "class": "LogWatcher",
  "file": "/home/pi/rob.log",
  "attributes": [
    {
      "name": "tariff1",
      "type": "number",
      "unit": "kWh"
    },
    {
      "name": "tariff2",
      "type": "number",
      "unit": "kWh"
    }
  ],
  "lines": [
    {
      "match": "1-0:1\\.8\\.1\\x28([0-9]+\\.[0-9]+)kWh\\x29",
      "tariff1": "$1"
    },
    {
      "match": "1-0:1\\.8\\.2\\x28([0-9]+\\.[0-9]+)kWh\\x29",
      "tariff2": "$1"
    }
  ]
},

and the device for that looks this here :

and these are the variables

with these variables you are now able to calculate things like for example daily energy consumption.

hope this helps!

cheers
chris

@leader21 This is awesome!

Thnx will give it a shot today.

It works!

GREAT!

Only thing is my current usage in Watt

I made:
{
“match”: “1-0:1\.7\.0\x28[0-9]+\.([0-9]+).kW\x29”,
“Current”: “$1+0”
}

That 0 is to add a extra zero behind the read out of the log.
Because the logs is in kW but i want Watt so there has te be a extra 0

Also tried:

{
“match”: “1-0:1\.7\.0\x28[0-9]+\.([0-9]+).kW\x29”,
“Current”: “($1)0”
}

What is it I am doing wrong?

@leader21 said:

“unit”: “kWh”

Remove the 0 again and change that to

"unit": "W"

Also tried to make 2 groups and set them next to each other.

Just trying to be creative

{
      "id": "energymeter_current",
      "name": "Current Usage",
      "class": "LogWatcher",
      "file": "/home/pi/rob.log",
      "attributes": [
        {
          "name": "Current",
          "type": "number",
          "unit": "Watt"
        }
      ],
      "lines": [
        {
          "match": "1-(0):1\\.7\\.0\\x28[0-9]+\\.([0-9]+0).kW\\x29",
          "Current": "$2,$1"
        }

But that doesn’t work either…

Just to say I AM A NEWBIE

Btw my log entry of current usage is:

1-0:1.7.0(0000.78*kW)

Tried what I said or did we post at the same time?

your current usage is 0.61 kW, this is 610 Watt.
usually this here should be your energy meter output right now, correct?

and this is the correct reading 0.610 kW = 610 Watt
having the current in Watt is some kind of “cosmetic”

the logreader is taking your output from the logfile and converts it 1:1 to a variable. You could change the unit from kW to W but this would have no influence to the value of the variable. 0.61 stays 0.61, doesn’t matter if W, kW or MW …

there’s a workaround possible.
If you try to display this as 610 Watt, I suggest you need to create a new variable called $current-new, a rule that says "if $robs-energy-meter.current changes THEN current-new=$robs-energy-meter.current*1000. Then you need to create a variables device for your current wattage.

give me a moment, i will show you how to set it up.

the logreader is taking your output from the logfile and converts it 1:1 to a variable. You could change the unit from kW to W but this would have no influence to the value of the variable. 0.61 stays 0.61, doesn’t matter if W, kW or MW

I thought the mobile frontend took care of rounding with the human format thingy, or doesn’t that work with this?

now that you mentioned … hm …
i tried it with W and kWh, without any difference to the value.
and that’s what rob also experienced.
but i will give it another try later.

@leader21 said:

now that you mentioned … hm …
i tried it with W and kWh, without any difference to the value.
and that’s what rob also experienced.
but i will give it another try later.

Thats OK

I Will give it a shot also to try to get the right amount

here’s my solution :

and it goes like this :

    {
      "id": "robs-current-meter",
      "name": "Robs Current Meter",
      "class": "LogWatcher",
      "file": "/home/pi/rob.log",
      "attributes": [
        {
          "name": "current",
          "type": "number",
          "unit": "kW"
        }
      ],
      "lines": [
        {
          "match": "1-0:1\\.7\\.0\\x28([0-9]+\\.[0-9]+)kW\\x29",
          "current": "$1"
        }
      ]
    },
    {
      "id": "energymeter",
      "name": "Robs Energy Meter",
      "class": "LogWatcher",
      "file": "/home/pi/rob.log",
      "attributes": [
        {
          "name": "tariff1",
          "type": "number",
          "unit": "kWh"
        },
        {
          "name": "tariff2",
          "type": "number",
          "unit": "kWh"
        }
      ],
      "lines": [
        {
          "match": "1-0:1\\.8\\.1\\x28([0-9]+\\.[0-9]+)kWh\\x29",
          "tariff1": "$1"
        },
        {
          "match": "1-0:1\\.8\\.2\\x28([0-9]+\\.[0-9]+)kWh\\x29",
          "tariff2": "$1"
        }
      ]
    },
    {
      "id": "current-wattage",
      "class": "VariablesDevice",
      "name": "Robs Current Wattage",
      "variables": [
        {
          "name": "value",
          "type": "number",
          "expression": "$robs-current-meter.current*1000",
          "unit": "Watt"
	     }
      ]
    },

you’re having an extra logreader device that extracts the wattage from the log.
then the variables device will convert it to watt.

Damn I was just writing a post update and suddenly the answer is there

GREAT job m8

Sometimes faster then lightning.

well, yeah, if there’s time, there’s a solution

i was just wondering about the mobile frontend formating.
as i said, the logreader extracts a value as a variable.
then you declare, what unit this value / variable will have.

so it does not matter if you declare W, kW, MW or whatever. The value stays.

bug?

if @unit in ['kW', 'kWh']
        num = Math.round(value * 1e3) / 1e3
        num = num.toFixed(3)
      else
        num = Math.round(value * 1e2) / 1e2

So if log shows 0.165 and you take unit W
Math.round(0.165 * 1e2) = 17 / 1e2 = 0.17

but shouldn’t the code be:

else
        num = Math.round(value * 1e2) * 1e1

So if log shows 0.165 and you take unit W
Math.round(0.165 * 1e2) = 17 * 1e1 = 170

@sweetpi and @leader21 my brain hurts now can you confirm?

Code

Also the rounding is adding 5 Watt so if you have that every day it wont be accurate anymore.

wow strange…

This is my code for the first reading.

{
      "id": "energymeter2",
      "name": "Current Meter",
      "class": "LogWatcher",
      "file": "/home/pi/rob.log",
      "attributes": [
        {
          "name": "current",
          "type": "number",
          "unit": "kW"
        }
      ],
      "lines": [
        {
          "match": "1-0:1\\.7\\.0\\x28([0-9]+\\.[0-9]+).kW\\x29",
          "Current": "$1"
        }
      ]
    },

My log file looks like this:

/KMP5 KA6U001584708311

0-0:96.1.1(204B413655303031353834373038333131)
1-0:1.8.1(09882.000*kWh)
1-0:1.8.2(11017.000*kWh)
1-0:2.8.1(00000.000*kWh)
1-0:2.8.2(00000.000*kWh)
0-0:96.14.0(0001)
1-0:1.7.0(0000.78*kW)
1-0:2.7.0(0000.00*kW)
0-0:17.0.0(999*A)
0-0:96.3.10(1)
0-0:96.13.1()
0-0:96.13.0()
0-1:24.1.0(3)
0-1:96.1.0(3238313031353431303033303435303131)
0-1:24.3.0(150215140000)(00)(60)(1)(0-1:24.2.1)(m3)
(02852.891)
0-1:24.4.0(1)
!

But when using your script it shows:

https://dl.dropboxusercontent.com/u/68234596/2015-02-15_21-19-53.png

0000000

I CAN capture the 3 digits behind the .
But this is useless when consuming 0001.201*kW

totally lost right now…
Tomorrow there is an other day… Maybe I can see the type/mistake that i made…

@Rob-Jager
sorry!! there’ a typo!!

change the capital C to a small c in current if you’re using my chosen variables …