Query Processing in Flash-Based Storage-Centric Sensor Networks*

[Abstract]

In this project, we will build upon our existing work on data management and sensor networks to investigate innovative query processing algorithms for flash memory based storage-centric sensor networks. Of particular interest are the data management issues under sensor system workload given the unique read/write/erase characteristics of flash memory. Key issues to be investigated include (i) storage management on flash memory that exploits append-only writes, data update correlations, and data reusability of sensor system workload; (ii) lazy-update indexing that takes advantage of the unique characteristics of flash memory; (iii) distributed indexing that strikes a balance between updating cost and querying cost; and (iv) query processing and optimization algorithms under distributed in-network data storage.

[Relevant Publications]

  1. Y. Li, S. T. On, J. Xu, B. Choi, H. Hu. "Optimizing Non-Indexed Join Processing in Flash Storage-Based Systems." IEEE Transactions on Computers (TC), in press, 2012.
  2. S. T. On, Y. Li, B. He, M. Wu, Q. Luo, and J. Xu. "FD-Buffer: A Buffer Manager for Databases on Flash Disks." Proc. the 19th ACM International Conference on Information and Knowledge Management (CIKM '10), Toronto, Canada, October, 2010. (Short paper)
  3. Y. Li, J. Xu, B. Choi, and H. Hu. "StableBuffer: Optimizing Write Performance for DBMS Applications on Flash Devices." Proc. the 19th ACM International Conference on Information and Knowledge Management (CIKM '10), Toronto, Canada, October 2010.
  4. D. Wang, J. Xu, F. Wang, and J. Liu. "Mobile Filter: Exploring Migration of Filters for Error-Bounded Continuous Data Collection in Sensor Networks." IEEE Transactions on Vehicular Technology (TVT), 2010.
  5. S. T. On, H. Hu, Y. Li, and J. Xu. "Flash-Optimized B+-Tree." Journal of Computer Science and Technology (JCST), 5(3): 507-520, May 2010.
  6. Y. Li, S. T. On, J. Xu, B. Choi, and H. Hu. "DigestJoin: Exploiting Fast Random Reads for Flash-based Joins." Proc. the 10th International Conference on Mobile Data Management (MDM '09 ), Taipei, Taiwan, May 2009. [pdf]
  7. S. T. On, H. Hu, Y. Li, and J. Xu. "Lazy-Update B+-Tree for Flash Devices." Proc. the 10th International Conference on Mobile Data Management (MDM '09 ), Taipei, Taiwan, May 2009. [pdf]
  8. J. Xu, X. Tang, and W.-C. Lee. "Distributed Query Processing in Flash-based Sensor Networks." Frontiers of Computer Science in China, 2(3): 248-256, September 2008.

* This project is supported by the Research Grants Council (RGC), Hong Kong SAR, China under Project No. HKBU210808. For further information, please contact Jianliang Xu.