[BrianJastram]

<I added and set the MS_SEND_BUFFER_SIZE to 750.
I’ll keep monitoring the data and keep you informed.
Thanks again.

[BrianJastram]

<This is the output from the PUBLISHER_DEBUGs
<I’m not aware of any variable numbers getting truncated.

------------------------------------------ \/---- Line Saved to SD Card ----\/ 2019-11-14 15:10:00,-9999.00,4.715,26.75,0,0 Sending data to [ 0 ] data.envirodiy.org Outgoing JSON size: 319 <--EnviroDIYPublisher Connecting client <--EnviroDIYPublisher Client connected after 1084 ms <--EnviroDIYPublisher Current TX Buffer Size: 31 <--dataPublisherBase Current TX Buffer Size: 57 <--dataPublisherBase Current TX Buffer Size: 102 <--dataPublisherBase Current TX Buffer Size: 123 <--dataPublisherBase Current TX Buffer Size: 159 <--dataPublisherBase Current TX Buffer Size: 180 <--dataPublisherBase Current TX Buffer Size: 216 <--dataPublisherBase Current TX Buffer Size: 258 <--dataPublisherBase Current TX Buffer Size: 306 <--dataPublisherBase Current TX Buffer Size: 351 <--dataPublisherBase Current TX Buffer Size: 396 <--dataPublisherBase Current TX Buffer Size: 437 <--dataPublisherBase POST /api/data-stream/ HTTP/1.1 Host: data.envirodiy.org TOKEN: xx Content-Length: 319 Content-Type: application/json {"sampling_feature":"xx-99f5-4f4a-8a47-d23984075462","timestamp":"2019-11-14T15:10:00-06:00","xx-9134-4629-9da3-28fa855c91c2":-9999.00,"xx-f1cb-48d1-bae6-836ce28ceb19":4. 715,"xx-73e0-4348-995d-7c6ac55b5722":26.75,"xx-3870-4a7d-8890-1b1ca7e40446":0,"xx-d6ff-454f-ae61-02e5c2ea3fa0":0} Dumping the TX Buffer <--dataPublisherBase Stopping client <--EnviroDIYPublisher Client stopped after 672 ms <--EnviroDIYPublisher -- Response Code -- 201 ------------------------------------------

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40

------------------------------------------   \/---- Line Saved to SD Card ----\/ 2019-11-14 15:10:00,-9999.00,4.715,26.75,0,0       Sending data to [ 0 ] data.envirodiy.org Outgoing JSON size: 319 <--EnviroDIYPublisher Connecting client <--EnviroDIYPublisher Client connected after 1084 ms <--EnviroDIYPublisher Current TX Buffer Size: 31 <--dataPublisherBase   Current TX Buffer Size: 57 <--dataPublisherBase Current TX Buffer Size: 102 <--dataPublisherBase Current TX Buffer Size: 123 <--dataPublisherBase Current TX Buffer Size: 159 <--dataPublisherBase Current TX Buffer Size: 180 <--dataPublisherBase Current TX Buffer Size: 216 <--dataPublisherBase Current TX Buffer Size: 258 <--dataPublisherBase Current TX Buffer Size: 306 <--dataPublisherBase Current TX Buffer Size: 351 <--dataPublisherBase Current TX Buffer Size: 396 <--dataPublisherBase Current TX Buffer Size: 437 <--dataPublisherBase POST /api/data-stream/ HTTP/1.1 Host: data.envirodiy.org TOKEN: xx Content-Length: 319 Content-Type: application/json   {"sampling_feature":"xx-99f5-4f4a-8a47-d23984075462","timestamp":"2019-11-14T15:10:00-06:00","xx-9134-4629-9da3-28fa855c91c2":-9999.00,"xx-f1cb-48d1-bae6-836ce28ceb19":4. 715,"xx-73e0-4348-995d-7c6ac55b5722":26.75,"xx-3870-4a7d-8890-1b1ca7e40446":0,"xx-d6ff-454f-ae61-02e5c2ea3fa0":0}   Dumping the TX Buffer <--dataPublisherBase Stopping client <--EnviroDIYPublisher Client stopped after 672 ms <--EnviroDIYPublisher -- Response Code -- 201 ------------------------------------------

[BrianJastram]

Answers:
<Yes, 4 separate Mayfly’s
<WiFi is real (no hot-spot)
<3 loggers (2 cell and 1 WiFi) at same office, 4th logger is miles away
<The timing of the holes doesn’t necessarily match up
<I have changed modem settings with XCTU on one modem from airplane mode to Normal operation. I have also updated their firmware to the newest version, 11413
<I have a Decagon CTD-10 hooked up to the WiFi modem, rain gauges hooked up to 2 Mayflys and just a small solar panel on the 3rd.
<I’m using modular sensors.
These are the only build flags I have in my .ini

-DSDI12_EXTERNAL_PCINT -DNEOSWSERIAL_EXTERNAL_PCINT

1 2	-DSDI12_EXTERNAL_PCINT     -DNEOSWSERIAL_EXTERNAL_PCINT

I see the others now in my .ino. Looks like I’m going to be doing some flag building and testing now. I’ll get back to you on this topic.
<I am using LTE carrier boards for the LTEXBee’s.
<I have “useCTSforStatus” set false for all 4 Mayflys. I guess I should change it to true for the WiFi setup.
<I’ll keep an eye out for the blinking light clue.
Thanks for your help.

[BrianJastram]

Yes, some.
All 4 modems are in transparent mode and there are no gaps on the SD card. The issue is on both the WiFi (1) and cellular (3) modems and the gaps are there in the data in all 3 ways I view the data on MMW except sparklines because those don’t show small gaps. Regarding Hologram some of my data sessions have no data consumption and some of the time periods are missed (see attachment).
Thanks

Attachments:

1. 

   Hologram.jpg
   

[BrianJastram]

Adam, Maybe give ModularSensors 0.23.11 a try. See https://www.envirodiy.org/topic/response-code-504-sending-data-to-data-envirodiy-org/
It’s kind of working for me and Dan. Currently though I’m getting exactly 24 hour gaps in my data stream to MMW.

[BrianJastram]

Fantastic! That’s just great. It feels good to have helped.

[BrianJastram]

Dan,
That is so frustrating. It sounds like you are making good efforts at troubleshooting.
Besides trying ModularSensors Library version 0.23.11 and checking that the *.ino file and Platformio.ini file are not conflicting I’m running out of ideas. You’ve got your modem connected to the internet but that MMW connection just ins’t happening.
You might find some clues in this post: https://www.envirodiy.org/topic/logging-to-mmw-with-gprsbee-rev-7-issue-wake-sleep-and-server-response-504/

[BrianJastram]

Dan,

I’m using Platform IO.
I assume you’re talking about the ‘Recent Data Sessions Table’ when you referenced the hologram activity log. I use that also and have noticed (and submitted a ticket for the fact) that when my data makes it through to MMW a single data session uses about 2-3 K bytes of data and all these other times I’m experiencing data NOT being transmitted to MMW there is still 300-400 bytes of data in a data session.

Regarding differences in how the sketch is compiled, I was guided to Platform IO for this MMW project. One thing Platform IO has is this Platformoi.ini file

; PlatformIO Project Configuration File ; ; Build options: build flags, source filter ; Upload options: custom upload port, speed and extra flags ; Library options: dependencies, extra library storages ; Advanced options: extra scripting ; ; Please visit documentation for the other options and examples ; http://docs.platformio.org/page/projectconf.html [platformio] description = ModularSensors example logging data to an SD card ; src_dir = tutorials\logging_to_MMW ; src_dir = .piolibdeps\EnviroDIY_DS3231_ID2079\examples\PCsync //http://www.unixtimestamp.com/ or http://time.sodaq.net/ src_dir = SAVPW-RG [env:mayfly] monitor_speed = 115200 board = mayfly platform = atmelavr framework = arduino lib_ldf_mode = deep+ lib_ignore = RTCZero build_flags = -DSDI12_EXTERNAL_PCINT -DNEOSWSERIAL_EXTERNAL_PCINT lib_deps = EnviroDIY_ModularSensors@=0.23.11 ; ^^ Use this when working from an official release of the library ; https://github.com/EnviroDIY/ModularSensors.git#816badd339737d8eec3492bc36ea1a2db02e2aac ; ^^ Use this when if you want to pull from the develop branch https://github.com/PaulStoffregen/AltSoftSerial.git https://github.com/SRGDamia1/NeoSWSerial.git https://github.com/EnviroDIY/SoftwareSerial_ExternalInts.git ; ^^ These are software serial port emulator libraries, you may not need them

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35

; PlatformIO Project Configuration File ; ;   Build options: build flags, source filter ;   Upload options: custom upload port, speed and extra flags ;   Library options: dependencies, extra library storages ;   Advanced options: extra scripting ; ; Please visit documentation for the other options and examples ; http://docs.platformio.org/page/projectconf.html   [platformio] description = ModularSensors example logging data to an SD card ; src_dir = tutorials\logging_to_MMW ; src_dir = .piolibdeps\EnviroDIY_DS3231_ID2079\examples\PCsync //http://www.unixtimestamp.com/ or http://time.sodaq.net/ src_dir = SAVPW-RG   [env:mayfly] monitor_speed = 115200 board = mayfly platform = atmelavr framework = arduino lib_ldf_mode = deep+ lib_ignore = RTCZero build_flags =     -DSDI12_EXTERNAL_PCINT     -DNEOSWSERIAL_EXTERNAL_PCINT lib_deps =     EnviroDIY_ModularSensors@=0.23.11 ;  ^^ Use this when working from an official release of the library ;    https://github.com/EnviroDIY/ModularSensors.git#816badd339737d8eec3492bc36ea1a2db02e2aac ;  ^^ Use this when if you want to pull from the develop branch     https://github.com/PaulStoffregen/AltSoftSerial.git     https://github.com/SRGDamia1/NeoSWSerial.git     https://github.com/EnviroDIY/SoftwareSerial_ExternalInts.git ;  ^^ These are software serial port emulator libraries, you may not need them

It helps with libraries and stuff. It lives in your root directory (C:\Users\brian.jastram\Documents\GitHub\MWMO-Deployments)

[BrianJastram]

Dan,
My output looks like this:
Sending data to [ 0 ] data.envirodiy.org
POST /api/data-stream/ HTTP/1.1
Host: data.envirodiy.org
TOKEN: XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
Content-Length: 318
Content-Type: application/json

{“sampling_feature”:”XXXX”,”timestamp”:”2019-10-08T07:25:00-06:00″,”XXXX”:0.00,”XXXX”:4.806,”XXXX”:23.00,”XXXX”:-57,”XXXX”:90}

Response Code —
201

[BrianJastram]

Maybe it’s a ModularSensors Library problem. I’m using version 0.23.11

[Author]

Posts