Home | About Us | Our Technology | DVS | Blog | Publications | Team | Jobs | Contact
This list contains select peer-reviewed and internal publications.
Some were written before nLine was started, and represent our foundational ideas.
Scientific integrity is a core value and we will continue to publish our learnings.
Check back for internal studies, documents produced for customers, and opinion pieces, all currently under development.
2021
-
Watching the Grid: Utility-Independent Measurements of Electricity Reliability in Accra, Ghana
Noah Klugman, Joshua Adkins, Emily Paszkiewicz, Molly G. Hickman, Matthew Podolsky, Jay Taneja, and Prabal Dutta
International Conference on Information Processing in Sensor Networks (co-located with CPS-IoT Week 2021) (IPSN’21)
[paper] [slides (as pdf)] [conference]
@inbook{klugman21watching, author = {Klugman, Noah and Adkins, Joshua and Paszkiewicz, Emily and Hickman, Molly G. and Podolsky, Matthew and Taneja, Jay and Dutta, Prabal}, title = {Watching the Grid: Utility-Independent Measurements of Electricity Reliability in Accra, Ghana}, year = {2021}, isbn = {9781450380980}, publisher = {Association for Computing Machinery}, address = {New York, NY, USA}, url = {https://doi.org/10.1145/3412382.3458276}, booktitle = {Proceedings of the 20th International Conference on Information Processing in Sensor Networks (Co-Located with CPS-IoT Week 2021)}, pages = {341–356}, numpages = {16} }
In much of the world, electricity grids are not instrumented at the customer level, limiting insights into the power quality experienced by utility customers. Moreover, to understand grid performance, regulators and investors must depend on utilities to self-report reliability data. To address these challenges, we introduce PowerWatch, an agile methodology to directly measure customer experience and aggregated grid performance without relying on the utility for deployment or management. PowerWatch employs a system of distributed sensors coupled with cloud-based analytics. We evaluate the PowerWatch methodology by deploying 462 sensors in homes and businesses in Accra, Ghana for over a year, yielding the largest open-source data set on electricity reliability at the customer-level in the region. We describe the architecture, design, and performance of PowerWatch, as well as the data that are collected, explaining how we determine the accuracy and coverage of our methodology without ground truth. Finally, we report on grid performance issues, finding nearly twice as many outages as the utility observed, suggesting a need for better grid performance monitoring.
Content has been formatted as TeX source. Click to format for web.
In much of the world, electricity grids are not instrumented at the customer level, limiting insights into the power quality experienced by utility customers. Moreover, to understand grid performance, regulators and investors must depend on utilities to self-report reliability data. To address these challenges, we introduce PowerWatch, an agile methodology to directly measure customer experience and aggregated grid performance without relying on the utility for deployment or management. PowerWatch employs a system of distributed sensors coupled with cloud-based analytics. We evaluate the PowerWatch methodology by deploying 462 sensors in homes and businesses in Accra, Ghana for over a year, yielding the largest open-source data set on electricity reliability at the customer-level in the region. We describe the architecture, design, and performance of PowerWatch, as well as the data that are collected, explaining how we determine the accuracy and coverage of our methodology without ground truth. Finally, we report on grid performance issues, finding nearly twice as many outages as the utility observed, suggesting a need for better grid performance monitoring.
2019
-
Hardware, Apps, and Surveys at Scale: Insights from Measuring Grid Reliability in Accra, Ghana
Noah Klugman, Joshua Adkins, Susanna Berkouwer, Kwame Abrokwah, Ivan Bobashev, Pat Pannuto, Matthew Podolsky, Aldo Susenot, Revati Thatte, Catherine Wolfram, Jay Taneja, and Prabal Dutta
ACM SIGCAS Conference on Computing and Sustainable Societies (COMPASS’19)
[paper] [slides (as pdf)] [conference]
@inproceedings{klugman19scale, booktitle = {ACM SIGCAS Conference on Computing and Sustainable Societies}, title = {Hardware, Apps, and Surveys at Scale: Insights from Measuring Grid Reliability in Accra, Ghana}, series = {COMPASS'19}, year = {2019}, month = {July}, location = {Accra, Ghana}, conference-url = {https://acmcompass.org/}, author = {Klugman, Noah and Adkins, Joshua and Berkouwer, Susanna and Abrokwah, Kwame and Bobashev, Ivan and Pannuto, Pat and Podolsky, Matthew and Susenot, Aldo and Thatte, Revati and Wolfram, Catherine and Taneja, Jay and Dutta, Prabal}, }
The vision of sensor systems that collect critical and previously ungathered information about the world is often only realized when sensors, students, and subjects move outside the academic laboratory. However, deployments at even the smallest scales introduce complexities and risks that can be difficult for a research team to anticipate. Over the past year, our interdisciplinary team of engineers and economists has been designing, deploying, and operating a large sensor network in Accra, Ghana that measures power outages and quality at households and firms. This network consists of 457 custom sensors, over 3,000 mobile app instances, thousands of participant surveys, and custom user incentive and deployment management systems. In part, this deployment supports an evaluation of the impacts of investments in the grid on reliability and the subsequent effects of improvements in reliability on socioeconomic well-being. We report our experiences as we move from performing small pilot deployments to our current scale, attempting to identify the pain points at each stage of the deployment. Finally, we extract high-level observations and lessons learned from our deployment activities, which we wish we had originally known when forecasting budgets, human resources, and project timelines. These insights will be critical as we look toward scaling our deployment to the en-tire city of Accra and beyond, and we hope that they will encourage and support other researchers looking to measure highly granular information about our world’s critical systems.
Content has been formatted as TeX source. Click to format for web.
The vision of sensor systems that collect critical and previously ungathered information about the world is often only realized when sensors, students, and subjects move outside the academic laboratory. However, deployments at even the smallest scales introduce complexities and risks that can be difficult for a research team to anticipate. Over the past year, our interdisciplinary team of engineers and economists has been designing, deploying, and operating a large sensor network in Accra, Ghana that measures power outages and quality at households and firms. This network consists of 457 custom sensors, over 3,000 mobile app instances, thousands of participant surveys, and custom user incentive and deployment management systems. In part, this deployment supports an evaluation of the impacts of investments in the grid on reliability and the subsequent effects of improvements in reliability on socioeconomic well-being. We report our experiences as we move from performing small pilot deployments to our current scale, attempting to identify the pain points at each stage of the deployment. Finally, we extract high-level observations and lessons learned from our deployment activities, which we wish we had originally known when forecasting budgets, human resources, and project timelines. These insights will be critical as we look toward scaling our deployment to the en-tire city of Accra and beyond, and we hope that they will encourage and support other researchers looking to measure highly granular information about our world’s critical systems.
-
The Open INcentive Kit (OINK): Standardizing the Generation, Comparison, and Deployment of Incentive Systems
Noah Klugman, Santiago Correa, Pat Pannuto, Matthew Podolsky, Jay Taneja, and Prabal Dutta
The Tenth International Conference on Information and Communication Technologies and Development (ICTD’19)
[paper] [slides (as pdf)] [conference]
@inproceedings{klugman19oink, booktitle = {The Tenth International Conference on Information and Communication Technologies and Development}, title = {The {Open} {INcentive} {Kit} {(OINK)}: Standardizing the Generation, Comparison, and Deployment of Incentive Systems}, series = {ICTD'19}, year = {2019}, month = {1}, location = {Ahmedabad, India}, conference-url = {https://www.ictdx.org/}, author = {Klugman, Noah and Correa, Santiago and Pannuto, Pat and Podolsky, Matthew and Taneja, Jay and Dutta, Prabal}, }
Incentives are a key facet of human studies research, yet the state-of-the-art often designs and implements incentive systems in an ad-hoc, on-demand manner. We introduce the first vocabulary for formally describing incentive systems and develop a software infrastructure that enables UI-based graphical generation of complex, auditable, reliable, and reproducible incentive systems. We call this infrastructure the Open INcentive Kit (OINK). A review of recent literature from several communities finds that of the one hundred and twenty-one publications that incorporate incentives, only thirty-one describe their incentive system in detail, and all of these could be implemented using OINK. We evaluate OINK in practice by using it for an active energy monitoring deployment in Ghana and find that OINK successfully facilitates thousands of individual incentive payments. Finally, we describe our efforts to generalize OINK for different research communities, specifically focusing on architectural decisions around extensibility to support unanticipated use cases. OINK is free and open-source software.
Content has been formatted as TeX source. Click to format for web.
Incentives are a key facet of human studies research, yet the state-of-the-art often designs and implements incentive systems in an ad-hoc, on-demand manner. We introduce the first vocabulary for formally describing incentive systems and develop a software infrastructure that enables UI-based graphical generation of complex, auditable, reliable, and reproducible incentive systems. We call this infrastructure the Open INcentive Kit (OINK). A review of recent literature from several communities finds that of the one hundred and twenty-one publications that incorporate incentives, only thirty-one describe their incentive system in detail, and all of these could be implemented using OINK. We evaluate OINK in practice by using it for an active energy monitoring deployment in Ghana and find that OINK successfully facilitates thousands of individual incentive payments. Finally, we describe our efforts to generalize OINK for different research communities, specifically focusing on architectural decisions around extensibility to support unanticipated use cases. OINK is free and open-source software.
2018
-
Experience: Android Resists Liberation from Its Primary Use Case
Noah Klugman, Veronica Jacome, Meghan Clark, Matthew Podolsky, Pat Pannuto, Neal Jackson, Aley Soud Nassor, Catherine Wolfram, Duncan Callaway, Jay Taneja, and Prabal Dutta
The 24th Annual International Conference on Mobile Computing and Networking (MobiCom’18)
[paper] [slides (as pdf)] [conference]
@inproceedings{klugman18liberation, booktitle = {The 24th Annual International Conference on Mobile Computing and Networking}, title = {Experience: Android Resists Liberation from Its Primary Use Case}, series = {MobiCom'18}, year = {2018}, month = {10}, location = {New Delhi, India}, conference-url = {http://www.sigmobile.org/mobicom/2018/}, author = {Klugman, Noah and Jacome, Veronica and Clark, Meghan and Podolsky, Matthew and Pannuto, Pat and Jackson, Neal and Nassor, Aley Soud and Wolfram, Catherine and Callaway, Duncan and Taneja, Jay and Dutta, Prabal}, }
Network connectivity is often one of the most challenging aspects of deploying sensors. In many countries, cellular networks provide the most reliable, highest bandwidth, and greatest coverage option for internet access. While this makes smartphones a seemingly ideal platform to serve as a gateway between sensors and the cloud, we find that a device designed for multi-tenant operation and frequent human interaction becomes unreliable when tasked to continuously run a single application with no human interaction, a seemingly counter-intuitive result. Further, we find that economy phones cannot physically withstand continuous operation, resulting in a surprisingly high rate of permanent device failures in the field. If these observations hold more broadly, they would make mobile phones poorly suited to a range of sensing applications for which they have been rumored to hold great promise.
Content has been formatted as TeX source. Click to format for web.
Network connectivity is often one of the most challenging aspects of deploying sensors. In many countries, cellular networks provide the most reliable, highest bandwidth, and greatest coverage option for internet access. While this makes smartphones a seemingly ideal platform to serve as a gateway between sensors and the cloud, we find that a device designed for multi-tenant operation and frequent human interaction becomes unreliable when tasked to continuously run a single application with no human interaction, a seemingly counter-intuitive result. Further, we find that economy phones cannot physically withstand continuous operation, resulting in a surprisingly high rate of permanent device failures in the field. If these observations hold more broadly, they would make mobile phones poorly suited to a range of sensing applications for which they have been rumored to hold great promise.