[dan@wachusett]

Neil/Anthony,

I think we will be able to purchase one Keller CTD this year and I will work on getting it going on the Mayfly 1.1 in whatever spare time I can find in my schedule. I appreciate all the input so far and I am looking forward to digging into this in the coming months. I will keep you both posted as I get going… I’m sure there will be lots of questions. Gathering any necessary hardware will be the first step, so I will check out the RS485 driver wing board you mention above. Unfortunately, working for a government agency makes it rather impossible for me to purchase additional sensors for testing/development.

Regards,

Dan

 

[dan@wachusett]

Thanks for the advice Neil, I think you helped me figure out a path forward here. I have a stream with long-term monitoring data that I do not want to interrupt, so my inclination is to use a sensor that I know how to use (Hydros 21) and if budget/free time allows I would purchase the Keller CTD without being under any time constraints to get it deployed. From the input that you and Anthony provided I am fairly confident that the Keller CTD sensor could work with the Mayfly… I just need to figure out if I can realistically dedicate the time needed to take the lead in figuring it out. It certainly sounds interesting and I know it would be a great learning opportunity.

[dan@wachusett]

Thanks for the information everyone, I really appreciate it!

It sounds like RS485 is the way to go if I want to keep it simpler and use methods similar (hopefully) to the Acculevel 0r Nanolevel sensors. The RS485 interface only requires 3.2 V, so does this mean that no voltage booster/level shifter would be required?

The RS485 version would have 4 wires in the cable (power, ground, RS485A, RS485B)… would I be able to connect this to the Mayfly using the EnviroDIY Multipurpose 6-pin Screw Terminal Grove Adapter?

At the moment I am a bit hesitant to be the first to try this sensor with the Mayfly given that I only have a very limited understanding of the electronics and communications protocols. If I were to do this I would need a fair amount of assistance along the way, and I have no idea how simple/complicated this would be.

If there were interest from others and expertise to lend, I could be up for the challenge.

[dan@wachusett]

Thanks for your input Neil and Cal. I pulled my station from the field where the battery was not recharging so I could do some testing. I’ll report back with my testing results to see if anyone has any advice. I would still be interested in the 12 v battery option if anyone out there uses one successfully with their Mayfly board v 0.5.

[dan@wachusett]

I am experiencing a similar issue that may be related, although without the RTC issue…

• Built with Modular sensors v0.30.0
• Data is saved to SD card when connected to computer via cable. RTC time is correct (or close enough)
• If I disconnect the board from the computer it fails to wake up or log any data to the SD card
• Battery voltage is sufficient (3.88 V, tested with multimeter)
• One of my boards was operating fine using a previous sketch and prior version of modular sensor dependencies, so I don’t think its a hardware issue. I am experiencing the exact same problem on 6 boards.

I’ve included my sketch below (UUIDs and Tokens have been scrubbed). I have seen sketch examples (DRWI_LTE.ino) where the wake pin is set to 31, whereas I have it set to A7. Perhaps this is the issue? If anyone has any thoughts or suggestions for troubleshooting please let me know.

Thanks,

Dan

/***************************************************************************** Mayfly_WACH-MD01.ino Written By: Sara Damiano (sdamiano@stroudcenter.org) Development Environment: Arduino IDE Hardware Platform: EnviroDIY Mayfly Arduino Datalogger Software License: BSD-3. Copyright (c) 2017, Stroud Water Research Center (SWRC) and the EnviroDIY Development Team This example sketch is written for ModularSensors library version 0.23.16 This sketch is an example of logging data to an SD card and sending the data to both the EnviroDIY data portal as should be used by groups involved with The William Penn Foundation's Delaware River Watershed Initiative DISCLAIMER: THIS CODE IS PROVIDED "AS IS" - NO WARRANTY IS GIVEN. * Modified by Dan Crocker - October 2021 *****************************************************************************/ // ========================================================================== // Defines for the Arduino IDE // In PlatformIO, set these build flags in your platformio.ini // ========================================================================== #ifndef TINY_GSM_RX_BUFFER #define TINY_GSM_RX_BUFFER 64 #endif #ifndef TINY_GSM_YIELD_MS #define TINY_GSM_YIELD_MS 2 #endif // ========================================================================== // Include the base required libraries // ========================================================================== #include <Arduino.h> // The base Arduino library #include <EnableInterrupt.h> // for external and pin change interrupts #include <LoggerBase.h> // The modular sensors library // ========================================================================== // Data Logger Settings // ========================================================================== // The name of this file const char* sketchName = "Mayfly_WACH-MD01.ino"; // Logger ID, also becomes the prefix for the name of the data file on SD card const char* LoggerID = "WACH-MD01"; // How frequently (in minutes) to log data const uint8_t loggingInterval = 15; // Your logger's timezone. const int8_t timeZone = 0; // UTC // NOTE: Daylight savings time will not be applied! Please use standard time! // ========================================================================== // Primary Arduino-Based Board and Processor // ========================================================================== #include <sensors/ProcessorStats.h> const long serialBaud = 115200; // Baud rate for the primary serial port for debugging const int8_t greenLED = 8; // MCU pin for the green LED (-1 if not applicable) const int8_t redLED = 9; // MCU pin for the red LED (-1 if not applicable) const int8_t buttonPin = 21; // MCU pin for a button to use to enter debugging mode (-1 if not applicable) const int8_t wakePin = A7; // MCU interrupt/alarm pin to wake from sleep // Set the wake pin to -1 if you do not want the main processor to sleep. // In a SAMD system where you are using the built-in rtc, set wakePin to 1 const int8_t sdCardPwrPin = -1; // MCU SD card power pin (-1 if not applicable) const int8_t sdCardSSPin = 12; // MCU SD card chip select/slave select pin (must be given!) const int8_t sensorPowerPin = 22; // MCU pin controlling main sensor power (-1 if not applicable) // Create the main processor chip "sensor" - for general metadata const char* mcuBoardVersion = "v0.5b"; ProcessorStats mcuBoard(mcuBoardVersion); // Create battery voltage variable pointers for the processor Variable* mcuBoardBatt = new ProcessorStats_Battery(&mcuBoard, "12345678-abcd-1234-ef00-1234567890ab"); /** End [processor_sensor] */ // ========================================================================== // Wifi/Cellular Modem Options // ========================================================================== /** Start [xbee_cell_transparent] */ // For any Digi Cellular XBee's // NOTE: The u-blox based Digi XBee's (3G global and LTE-M global) // are more stable used in bypass mode (below) // The Telit based Digi XBees (LTE Cat1) can only use this mode. #include <modems/DigiXBeeCellularTransparent.h> // Create a reference to the serial port for the modem HardwareSerial& modemSerial = Serial1; // Use hardware serial if possible const int32_t modemBaud = 9600; // All XBee's use 9600 by default // Modem Pins - Describe the physical pin connection of your modem to your board // NOTE: Use -1 for pins that do not apply const int8_t modemVccPin = -2; // MCU pin controlling modem power const int8_t modemStatusPin = 19; // MCU pin used to read modem status const bool useCTSforStatus = false; // Flag to use the modem CTS pin for status const int8_t modemResetPin = 20; // MCU pin connected to modem reset pin const int8_t modemSleepRqPin = 23; // MCU pin for modem sleep/wake request const int8_t modemLEDPin = redLED; // MCU pin connected an LED to show modem // status (-1 if unconnected) // Network connection information const char* apn = "vzwinternet"; // The APN for the gprs connection DigiXBeeCellularTransparent modemXBCT(&modemSerial, modemVccPin, modemStatusPin, useCTSforStatus, modemResetPin, modemSleepRqPin, apn); // Create an extra reference to the modem by a generic name DigiXBeeCellularTransparent modem = modemXBCT; // Create RSSI and signal strength variable pointers for the modem Variable* modemRSSI = new Modem_RSSI(&modem, "12345678-abcd-1234-ef00-1234567890ab"); Variable* modemSignalPct = new Modem_SignalPercent(&modem, "12345678-abcd-1234-ef00-1234567890ab"); // ========================================================================== // Maxim DS3231 RTC (Real Time Clock) // ========================================================================== #include <sensors/MaximDS3231.h> // Create a DS3231 sensor object MaximDS3231 ds3231(1); // Create a temperature variable pointer for the DS3231 Variable* ds3231Temp = new MaximDS3231_Temp(&ds3231, "12345678-abcd-1234-ef00-1234567890ab"); // Deleted Campbell Scientific Sensor - Not Applicable here // ========================================================================== // Meter Hydros 21 Conductivity, Temperature, and Depth Sensor // ========================================================================== /** Start [hydros21] */ #include <sensors/MeterHydros21.h> const char* hydrosSDI12address = "1"; // The SDI-12 Address of the Hydros 21 const uint8_t hydrosNumberReadings = 6; // The number of readings to average const int8_t SDI12Power = sensorPowerPin; // Power pin (-1 if unconnected) const int8_t SDI12Data = 7; // The SDI12 data pin // Create a Meter Hydros 21 sensor object MeterHydros21 hydros(*hydrosSDI12address, SDI12Power, SDI12Data, hydrosNumberReadings); // Create specific conductance depth and temperature variable pointers for the Hydros21 sensor Variable* Hydros21Cond = new MeterHydros21_Cond(&hydros, "12345678-abcd-1234-ef00-1234567890ab"); Variable* Hydros21Depth = new MeterHydros21_Depth(&hydros, "12345678-abcd-1234-ef00-1234567890ab"); Variable* Hydros21Temp = new MeterHydros21_Temp(&hydros, "12345678-abcd-1234-ef00-1234567890ab"); /** End [hydros21] */ // ========================================================================== // Creating the Variable Array[s] and Filling with Variable Objects // ========================================================================== Variable* variableList[] = { Hydros21Cond, Hydros21Depth, Hydros21Temp, mcuBoardBatt, ds3231Temp, modemRSSI, modemSignalPct }; // *** CAUTION --- CAUTION --- CAUTION --- CAUTION --- CAUTION *** // Check the order of your variables in the variable list!!! // Be VERY certain that they match the order of your UUID's! // Rearrange the variables in the variable list if necessary to match! // *** CAUTION --- CAUTION --- CAUTION --- CAUTION --- CAUTION *** const char* REGISTRATION_TOKEN = "12345678-abcd-1234-ef00-1234567890ab"; // Device registration token const char* SAMPLING_FEATURE = "12345678-abcd-1234-ef00-1234567890ab"; // Sampling feature UUID // Count up the number of pointers in the array int variableCount = sizeof(variableList) / sizeof(variableList[0]); // Create the VariableArray object VariableArray varArray(variableCount, variableList); // Put only the particularly interesting variables into a second array // NOTE: We can the same variables into multiple arrays Variable* variableList_toGo[] = { Hydros21Cond, Hydros21Depth, Hydros21Temp}; // Count up the number of pointers in the array int variableCount_toGo = sizeof(variableList_toGo) / sizeof(variableList_toGo[0]); // Create the VariableArray object VariableArray arrayToGo(variableCount_toGo, variableList_toGo); /** End [variable_arrays] */ // ========================================================================== // The Logger Object[s] // ========================================================================== // Create a new logger instance Logger dataLogger(LoggerID, loggingInterval, &varArray); // Create "another" logger for the variables to go out over the internet Logger loggerToGo(LoggerID, loggingInterval, &arrayToGo); // ========================================================================== // A Publisher to WikiWatershed // ========================================================================== // Device registration and sampling feature information can be obtained after // registration at http://data.WikiWatershed.org const char* registrationToken = REGISTRATION_TOKEN; // Device registration token const char* samplingFeature = SAMPLING_FEATURE; // Sampling feature UUID // Create a data publisher for the EnviroDIY/WikiWatershed POST endpoint #include <publishers/EnviroDIYPublisher.h> EnviroDIYPublisher EnviroDIYPOST(loggerToGo, &modem.gsmClient, registrationToken, samplingFeature); // ========================================================================== // Working Functions // ========================================================================== // Flashes the LED's on the primary board void greenredflash(uint8_t numFlash = 4, uint8_t rate = 75) { for (uint8_t i = 0; i < numFlash; i++) { digitalWrite(greenLED, HIGH); digitalWrite(redLED, LOW); delay(rate); digitalWrite(greenLED, LOW); digitalWrite(redLED, HIGH); delay(rate); } digitalWrite(redLED, LOW); } // Read's the battery voltage // NOTE: This will actually return the battery level from the previous update! float getBatteryVoltage() { if (mcuBoard.sensorValues[0] == -9999) mcuBoard.update(); return mcuBoard.sensorValues[0]; } // ========================================================================== // Main setup function // ========================================================================== void setup() { // Start the primary serial connection Serial.begin(serialBaud); // Print a start-up note to the first serial port Serial.print(F("Now running ")); Serial.print(sketchName); Serial.print(F(" on Logger ")); Serial.println(LoggerID); Serial.println(); // Serial.print(F("Using ModularSensors Library version ")); // Serial.println(MODULAR_SENSORS_VERSION); // if (String(MODULAR_SENSORS_VERSION) != String(libraryVersion)) // Serial.println(F( // "WARNING: THIS EXAMPLE WAS WRITTEN FOR A DIFFERENT VERSION OF MODULAR SENSORS!!")); // Start the serial connection with the modem modemSerial.begin(modemBaud); // Set up pins for the LED's pinMode(greenLED, OUTPUT); digitalWrite(greenLED, LOW); pinMode(redLED, OUTPUT); digitalWrite(redLED, LOW); // Blink the LEDs to show the board is on and starting up greenredflash(); // Set the timezones for the logger/data and the RTC // Logging in the given time zone Logger::setLoggerTimeZone(timeZone); // It is STRONGLY RECOMMENDED that you set the RTC to be in UTC (UTC+0) Logger::setRTCTimeZone(0); // Attach the modem and information pins to the logger dataLogger.attachModem(modem); loggerToGo.attachModem(modem); modem.setModemLED(modemLEDPin); dataLogger.setLoggerPins(wakePin, sdCardSSPin, sdCardPwrPin, buttonPin, greenLED); // Begin the logger dataLogger.begin(); // Note: Please change these battery voltages to match your battery // Check that the battery is OK before powering the modem if (getBatteryVoltage() > 3.55 || !dataLogger.isRTCSane()) { modem.modemPowerUp(); modem.wake(); modem.setup(); // Synchronize the RTC with NIST Serial.println(F("Attempting to connect to the internet and synchronize RTC with NIST")); if (modem.connectInternet(120000L)) { dataLogger.setRTClock(modem.getNISTTime()); } else { Serial.println(F("Could not connect to internet for clock sync.")); } } // Set up the sensors, except at lowest battery level if (getBatteryVoltage() > 3.4) { Serial.println(F("Setting up sensors...")); varArray.setupSensors(); } // Power down the modem modem.modemSleepPowerDown(); // Create the log file, adding the default header to it // Do this last so we have the best chance of getting the time correct and // all sensor names correct // Writing to the SD card can be power intensive, so if we're skipping // the sensor setup we'll skip this too. if (getBatteryVoltage() > 3.4) { dataLogger.turnOnSDcard(true); // true = wait for card to settle after power up dataLogger.createLogFile(true); // true = write a new header dataLogger.turnOffSDcard(true); // true = wait for internal housekeeping after write } // Call the processor sleep Serial.println(F("Putting processor to sleep\n")); dataLogger.systemSleep(); } // ========================================================================== // Main loop function // ========================================================================== // Use this short loop for simple data logging and sending void loop() { // Note: Please change these battery voltages to match your battery // At very low battery, just go back to sleep if (getBatteryVoltage() < 3.4) { dataLogger.systemSleep(); } // At moderate voltage, log data but don't send it over the modem else if (getBatteryVoltage() < 3.55) { dataLogger.logData(); } // If the battery is good, send the data to the world else { dataLogger.logData(); //loggerToGo.publishDataToRemotes(); // disable until SIM cards are installed } }

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367

/***************************************************************************** Mayfly_WACH-MD01.ino Written By:  Sara Damiano (sdamiano@stroudcenter.org) Development Environment: Arduino IDE Hardware Platform: EnviroDIY Mayfly Arduino Datalogger Software License: BSD-3.   Copyright (c) 2017, Stroud Water Research Center (SWRC)   and the EnviroDIY Development Team   This example sketch is written for ModularSensors library version 0.23.16   This sketch is an example of logging data to an SD card and sending the data to both the EnviroDIY data portal as should be used by groups involved with The William Penn Foundation's Delaware River Watershed Initiative   DISCLAIMER: THIS CODE IS PROVIDED "AS IS" - NO WARRANTY IS GIVEN. * Modified by Dan Crocker - October 2021 *****************************************************************************/   // ========================================================================== //    Defines for the Arduino IDE //    In PlatformIO, set these build flags in your platformio.ini // ========================================================================== #ifndef TINY_GSM_RX_BUFFER #define TINY_GSM_RX_BUFFER 64 #endif #ifndef TINY_GSM_YIELD_MS #define TINY_GSM_YIELD_MS 2 #endif   // ========================================================================== //    Include the base required libraries // ========================================================================== #include <Arduino.h>  // The base Arduino library #include <EnableInterrupt.h>  // for external and pin change interrupts #include <LoggerBase.h>  // The modular sensors library     // ========================================================================== //    Data Logger Settings // ========================================================================== // The name of this file const char* sketchName = "Mayfly_WACH-MD01.ino"; // Logger ID, also becomes the prefix for the name of the data file on SD card const char* LoggerID = "WACH-MD01"; // How frequently (in minutes) to log data const uint8_t loggingInterval = 15; // Your logger's timezone. const int8_t timeZone = 0;  // UTC // NOTE:  Daylight savings time will not be applied!  Please use standard time!     // ========================================================================== //    Primary Arduino-Based Board and Processor // ========================================================================== #include <sensors/ProcessorStats.h>   const long serialBaud = 115200;   // Baud rate for the primary serial port for debugging const int8_t greenLED = 8;        // MCU pin for the green LED (-1 if not applicable) const int8_t redLED = 9;          // MCU pin for the red LED (-1 if not applicable) const int8_t buttonPin = 21;      // MCU pin for a button to use to enter debugging mode  (-1 if not applicable) const int8_t wakePin = A7;        // MCU interrupt/alarm pin to wake from sleep // Set the wake pin to -1 if you do not want the main processor to sleep. // In a SAMD system where you are using the built-in rtc, set wakePin to 1 const int8_t sdCardPwrPin = -1;     // MCU SD card power pin (-1 if not applicable) const int8_t sdCardSSPin = 12;      // MCU SD card chip select/slave select pin (must be given!) const int8_t sensorPowerPin = 22;  // MCU pin controlling main sensor power (-1 if not applicable)   // Create the main processor chip "sensor" - for general metadata const char* mcuBoardVersion = "v0.5b"; ProcessorStats mcuBoard(mcuBoardVersion);   // Create battery voltage variable pointers for the processor Variable* mcuBoardBatt = new ProcessorStats_Battery(&mcuBoard, "12345678-abcd-1234-ef00-1234567890ab"); /** End [processor_sensor] */     // ========================================================================== //  Wifi/Cellular Modem Options // ========================================================================== /** Start [xbee_cell_transparent] */ // For any Digi Cellular XBee's // NOTE:  The u-blox based Digi XBee's (3G global and LTE-M global) // are more stable used in bypass mode (below) // The Telit based Digi XBees (LTE Cat1) can only use this mode. #include <modems/DigiXBeeCellularTransparent.h>   // Create a reference to the serial port for the modem HardwareSerial& modemSerial = Serial1;  // Use hardware serial if possible const int32_t   modemBaud   = 9600;     // All XBee's use 9600 by default   // Modem Pins - Describe the physical pin connection of your modem to your board // NOTE:  Use -1 for pins that do not apply const int8_t modemVccPin    = -2;    // MCU pin controlling modem power const int8_t modemStatusPin = 19;    // MCU pin used to read modem status const bool useCTSforStatus = false;  // Flag to use the modem CTS pin for status const int8_t modemResetPin = 20;     // MCU pin connected to modem reset pin const int8_t modemSleepRqPin = 23;   // MCU pin for modem sleep/wake request const int8_t modemLEDPin = redLED;   // MCU pin connected an LED to show modem                                      // status (-1 if unconnected)   // Network connection information const char* apn = "vzwinternet";  // The APN for the gprs connection    DigiXBeeCellularTransparent modemXBCT(&modemSerial, modemVccPin, modemStatusPin,                                       useCTSforStatus, modemResetPin,                                       modemSleepRqPin, apn); // Create an extra reference to the modem by a generic name DigiXBeeCellularTransparent modem = modemXBCT;   // Create RSSI and signal strength variable pointers for the modem Variable* modemRSSI = new Modem_RSSI(&modem, "12345678-abcd-1234-ef00-1234567890ab"); Variable* modemSignalPct = new Modem_SignalPercent(&modem, "12345678-abcd-1234-ef00-1234567890ab");     // ========================================================================== //    Maxim DS3231 RTC (Real Time Clock) // ========================================================================== #include <sensors/MaximDS3231.h>   // Create a DS3231 sensor object MaximDS3231 ds3231(1);   // Create a temperature variable pointer for the DS3231 Variable* ds3231Temp = new MaximDS3231_Temp(&ds3231, "12345678-abcd-1234-ef00-1234567890ab");   // Deleted Campbell Scientific Sensor - Not Applicable here   // ========================================================================== //  Meter Hydros 21 Conductivity, Temperature, and Depth Sensor // ========================================================================== /** Start [hydros21] */ #include <sensors/MeterHydros21.h>   const char*   hydrosSDI12address = "1";  // The SDI-12 Address of the Hydros 21 const uint8_t hydrosNumberReadings = 6;  // The number of readings to average const int8_t  SDI12Power = sensorPowerPin;  // Power pin (-1 if unconnected) const int8_t  SDI12Data  = 7;               // The SDI12 data pin   // Create a Meter Hydros 21 sensor object MeterHydros21 hydros(*hydrosSDI12address, SDI12Power, SDI12Data,                      hydrosNumberReadings);   // Create specific conductance depth and temperature variable pointers for the Hydros21 sensor Variable* Hydros21Cond =     new MeterHydros21_Cond(&hydros, "12345678-abcd-1234-ef00-1234567890ab"); Variable* Hydros21Depth =     new MeterHydros21_Depth(&hydros, "12345678-abcd-1234-ef00-1234567890ab");     Variable* Hydros21Temp =     new MeterHydros21_Temp(&hydros, "12345678-abcd-1234-ef00-1234567890ab");                   /** End [hydros21] */     // ========================================================================== //    Creating the Variable Array[s] and Filling with Variable Objects // ==========================================================================   Variable* variableList[] = {     Hydros21Cond,     Hydros21Depth,     Hydros21Temp,     mcuBoardBatt,     ds3231Temp,     modemRSSI,     modemSignalPct }; // *** CAUTION --- CAUTION --- CAUTION --- CAUTION --- CAUTION *** // Check the order of your variables in the variable list!!! // Be VERY certain that they match the order of your UUID's! // Rearrange the variables in the variable list if necessary to match! // *** CAUTION --- CAUTION --- CAUTION --- CAUTION --- CAUTION *** const char* REGISTRATION_TOKEN = "12345678-abcd-1234-ef00-1234567890ab";   // Device registration token const char* SAMPLING_FEATURE = "12345678-abcd-1234-ef00-1234567890ab";     // Sampling feature UUID   // Count up the number of pointers in the array int variableCount = sizeof(variableList) / sizeof(variableList[0]);   // Create the VariableArray object VariableArray varArray(variableCount, variableList);   // Put only the particularly interesting variables into a second array // NOTE:  We can the same variables into multiple arrays Variable* variableList_toGo[] = {   Hydros21Cond,     Hydros21Depth,   Hydros21Temp};   // Count up the number of pointers in the array int variableCount_toGo = sizeof(variableList_toGo) / sizeof(variableList_toGo[0]); // Create the VariableArray object VariableArray arrayToGo(variableCount_toGo, variableList_toGo); /** End [variable_arrays] */     // ========================================================================== //     The Logger Object[s] // ==========================================================================   // Create a new logger instance Logger dataLogger(LoggerID, loggingInterval, &varArray);   // Create "another" logger for the variables to go out over the internet Logger loggerToGo(LoggerID, loggingInterval, &arrayToGo);   // ========================================================================== //    A Publisher to WikiWatershed // ========================================================================== // Device registration and sampling feature information can be obtained after // registration at http://data.WikiWatershed.org const char* registrationToken = REGISTRATION_TOKEN; // Device registration token const char* samplingFeature = SAMPLING_FEATURE;     // Sampling feature UUID   // Create a data publisher for the EnviroDIY/WikiWatershed POST endpoint #include <publishers/EnviroDIYPublisher.h> EnviroDIYPublisher EnviroDIYPOST(loggerToGo, &modem.gsmClient, registrationToken, samplingFeature);     // ========================================================================== //    Working Functions // ==========================================================================   // Flashes the LED's on the primary board void greenredflash(uint8_t numFlash = 4, uint8_t rate = 75) {     for (uint8_t i = 0; i < numFlash; i++) {         digitalWrite(greenLED, HIGH);         digitalWrite(redLED, LOW);         delay(rate);         digitalWrite(greenLED, LOW);         digitalWrite(redLED, HIGH);         delay(rate);     }     digitalWrite(redLED, LOW); }     // Read's the battery voltage // NOTE: This will actually return the battery level from the previous update! float getBatteryVoltage() {     if (mcuBoard.sensorValues[0] == -9999) mcuBoard.update();     return mcuBoard.sensorValues[0]; }     // ========================================================================== // Main setup function // ========================================================================== void setup() {     // Start the primary serial connection     Serial.begin(serialBaud);       // Print a start-up note to the first serial port     Serial.print(F("Now running "));     Serial.print(sketchName);     Serial.print(F(" on Logger "));     Serial.println(LoggerID);     Serial.println();   //    Serial.print(F("Using ModularSensors Library version ")); //    Serial.println(MODULAR_SENSORS_VERSION);   //    if (String(MODULAR_SENSORS_VERSION) !=  String(libraryVersion)) //        Serial.println(F( //            "WARNING: THIS EXAMPLE WAS WRITTEN FOR A DIFFERENT VERSION OF MODULAR SENSORS!!"));       // Start the serial connection with the modem     modemSerial.begin(modemBaud);       // Set up pins for the LED's     pinMode(greenLED, OUTPUT);     digitalWrite(greenLED, LOW);     pinMode(redLED, OUTPUT);     digitalWrite(redLED, LOW);     // Blink the LEDs to show the board is on and starting up     greenredflash();       // Set the timezones for the logger/data and the RTC     // Logging in the given time zone     Logger::setLoggerTimeZone(timeZone);     // It is STRONGLY RECOMMENDED that you set the RTC to be in UTC (UTC+0)     Logger::setRTCTimeZone(0);       // Attach the modem and information pins to the logger     dataLogger.attachModem(modem); loggerToGo.attachModem(modem);     modem.setModemLED(modemLEDPin);     dataLogger.setLoggerPins(wakePin, sdCardSSPin, sdCardPwrPin, buttonPin, greenLED);       // Begin the logger     dataLogger.begin();       // Note:  Please change these battery voltages to match your battery     // Check that the battery is OK before powering the modem     if (getBatteryVoltage() > 3.55 || !dataLogger.isRTCSane())     {         modem.modemPowerUp();         modem.wake();         modem.setup();           // Synchronize the RTC with NIST         Serial.println(F("Attempting to connect to the internet and synchronize RTC with NIST"));         if (modem.connectInternet(120000L))         {             dataLogger.setRTClock(modem.getNISTTime());         }         else         {             Serial.println(F("Could not connect to internet for clock sync."));         }     }       // Set up the sensors, except at lowest battery level     if (getBatteryVoltage() > 3.4)     {         Serial.println(F("Setting up sensors..."));         varArray.setupSensors();     }       // Power down the modem     modem.modemSleepPowerDown();       // Create the log file, adding the default header to it     // Do this last so we have the best chance of getting the time correct and     // all sensor names correct     // Writing to the SD card can be power intensive, so if we're skipping     // the sensor setup we'll skip this too.     if (getBatteryVoltage() > 3.4)     {         dataLogger.turnOnSDcard(true);  // true = wait for card to settle after power up         dataLogger.createLogFile(true);  // true = write a new header         dataLogger.turnOffSDcard(true);  // true = wait for internal housekeeping after write     }       // Call the processor sleep     Serial.println(F("Putting processor to sleep\n"));     dataLogger.systemSleep(); }     // ========================================================================== // Main loop function // ==========================================================================   // Use this short loop for simple data logging and sending void loop() {     // Note:  Please change these battery voltages to match your battery     // At very low battery, just go back to sleep     if (getBatteryVoltage() < 3.4)     {         dataLogger.systemSleep();     }     // At moderate voltage, log data but don't send it over the modem     else if (getBatteryVoltage() < 3.55)     {         dataLogger.logData();     }     // If the battery is good, send the data to the world     else     {         dataLogger.logData(); //loggerToGo.publishDataToRemotes(); // disable until SIM cards are installed     } }

 

[dan@wachusett]

@vogelrnws, thanks for the digi link… this does seem like something that could work very well to send information to AWS from a XBee modem. There are still several steps to figure out in terms of getting a Mayfly program to execute the python code that is on the modem, perhaps like calling a function?, with the sensor data as the message formatted in a JSON string. These details are way beyond my capabilities, so I can’t really pursue this option on my own. I am hoping to come up with a solution that utilizes existing modular sensor libraries with some minor tweaks. Maybe this is unrealistic, but I have neither the time or ability to develop a novel solution from scratch, on my own. I am very thankful to be able to take advantage of all the existing work and know-how in this community.  I will keep researching options and report back if I find a solution that is within my technological reach.

[dan@wachusett]

@vogelrnws, We are using 4G LTE modems that are recommended by EnviroDIY with the LTE Bee Adapter. Verizon will send us SIM cards once we give them a list of IMEI numbers for the modems. Fortunately, our agency has access (with approval) for certain AWS storage/computing services, so I can take advantage of this since this project is relatively small, data-wise. I will only have 7 sensors sending data at 15 minute increments.

The main hurdles I need to address are items 2 and 3 in the original post on this thread. Basically, setting up a publisher script to push to an amazon endpoint, and configuring that endpoint to process the JSON data streams that get sent every 15 minutes.

[dan@wachusett]

Thanks for your input @neilh and @vogelrnws.  I work for a state agency, so I have limited options when it comes to IT related endeavors, especially things that are new (like technology from the last 20 years). I am basically trying to follow pathways that have been lightly trodden, rather than attempt to blaze my own trail.

I am in the process of building some new monitoring stations with Mayfly loggers and Hydros-21 sensors pushing data over the cell network with 4G LTE  modems. I have to use our existing Verizon accounts to add data plans using the M2M service, which actually seems pretty reasonably priced. I don’t mind using MMW for real-time data access, however my reason for wanting to push data to AWS is that we can leverage our existing account with ESRI to ingest data files from AWS into GeoEvent Server, which would enable us to make customized dashboards to display our real-time monitoring data. I know there are other options, but I first want to see if I can go the AWS/ESRI route because this workflow already has momentum at another agency in my state, and I can sort of “draft” behind that effort.

Personally, I am open to other options (like Thingspeak), however the hurdles in setting up new contracts for IT related services are almost insurmountable. Its not even a matter of cost ($650 a year is a pretty easy sell). However, I basically need to prove that this project will not work with our existing IT tools/products/services before anyone will entertain another option.

It took me 18 months just to purchase 1 Mayfly board due to all the bureaucratic and procurement protocols that are in place!

Thanks,
Dan

[dan@wachusett]

Thanks Shannon, that is sound advice. We have 7 new Gen 2 Hydros-21 sensors and I will be delving in to this more later this summer. I do plan to test them in a controlled environment to make sure that the variation in output is within the accuracy range specified by the manufacturer.

[dan@wachusett]

Thanks @fisherba… I will take a look at the updated sketch. It seems like this correction should be part of the device firmware, but perhaps it was modified at some point and not included. I may try to apply this correction to my previous data downloads and see if fixes the issue. If so, then will update the sketch on the mayfly to perform this correction prior to writing data to the sd card. I’ll update this post with results once I get to it… which might not be until later this summer.

[Author]

Posts