skip to main content
research-article

Power-reduction techniques for data-center storage systems

Published:03 July 2013Publication History
Skip Abstract Section

Abstract

As data-intensive, network-based applications proliferate, the power consumed by the data-center storage subsystem surges. This survey summarizes, organizes, and integrates a decade of research on power-aware enterprise storage systems. All of the existing power-reduction techniques are classified according to the disk-power factor and storage-stack layer addressed. A majority of power-reduction techniques is based on dynamic power management. We also consider alternative methods that reduce disk access time, conserve space, or exploit energy-efficient storage hardware. For every energy-conservation technique, the fundamental trade-offs between power, capacity, performance, and dependability are uncovered. With this survey, we intend to stimulate integration of different power-reduction techniques in new energy-efficient file and storage systems.

References

  1. Allalouf, M., Arbitman, Y., Factor, M., Kat, R. I., Meth, K., and Naor, D. 2009. Storage modeling for power estimation. In Proceedings of the 2nd Israeli Experimental Systems Conference (SYSTOR'09). 3:1--3:10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Amur, H., Cipar, J., Gupta, V., Ganger, G. R., Kozuch, M. A., and Schwan, K. 2010. Robust and flexible power-proportional storage. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC'10). 217--228. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Apple. 2004. Hfs plus volume format. Tech. rep. TN1150, Apple, Cupertino, CA, March. http://developer.apple.com/technotes/tn/tn1150.html.Google ScholarGoogle Scholar
  4. Barroso, L. A. and Hölzle, U. 2007. The case for energy-proportional computing. Computer 40, 33--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Benini, L. and Micheli, G. D. 2000. System-level power optimization: Techniques and tools. ACM Trans. Des. Autom. Electron. Syst. 5, 115--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bisson, T., Brandt, S., and Long, D. 2007. A hybrid disk-aware spin-down algorithm with i/o subsystem support. In Proceedings of the 26th IEEE International Performance Computing and Communications Conference (IPCCC'07). IEEE, Los Alamitos, CA, 236--245.Google ScholarGoogle Scholar
  7. Bisson, T., Brandt, S. A., and Long, D. D. E. 2006. Nvcache: Increasing the effectiveness of disk spin-down algorithms with caching. In Proceedings of the 14th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS'06). IEEE Computer Society, Washington, DC, 422--432. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Carrera, E. V., Pinheiro, E., and Bianchini, R. 2003. Conserving disk energy in network servers. In Proceedings of the 17th Annual International Conference on Supercomputing (ICS'03). 86--97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Caulfield, A. M., Grupp, L. M., and Swanson, S. 2009. Gordon: Using flash memory to build fast, power-efficient clusters for data-intensive applications. SIGPLAN Not. 44, 217--228. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chrobak, M. 2010. Sigact news online algorithms column 17. SIGACT News 41, 114--121. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Colarelli, D. and Grunwald, D. 2002. Massive arrays of idle disks for storage archives. In Proceedings of the ACM/IEEE Conference on Supercomputing (Supercomputing'02). 1--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Deng, Y. 2011. What is the future of disk drives, death or rebirth? ACM Comput. Surv. 43, 23:1--23:27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Douglis, F., Krishnan, P., and Bershad, B. N. 1995. Adaptive disk spin-down policies for mobile computers. In Proceedings of the 2nd Symposium on Mobile and Location-Independent Computing. 121--137. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Douglis, F., Krishnan, P., and Marsh, B. 1994. Thwarting the power-hungry disk. In Proceedings of the USENIX Winter Technical Conference. 23--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Essary, D. and Amer, A. 2008. Predictive data grouping: Defining the bounds of energy and latency reduction through predictive data grouping and replication. Trans. Storage 4, 2:1--2:23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Freitas, R. F. and Wilcke, W. W. 2008. Storage-class memory: The next storage system technology. IBM J. Res. Dev. 52, 439--447. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Ganesh, L., Weatherspoon, H., Balakrishnan, M., and Birman, K. 2007. Optimizing power consumption in large scale storage systems. In Proceedings of the 11th USENIX Workshop on Hot Topics in Operating Systems. 9:1--9:6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Golding, R., Bosch, P., Staelin, C., Sullivan, T., and Wilkes, J. 1995. Idleness is not sloth. In Proceedings of the USENIX Technical Conference (TCON'95). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Greenan, K. M., Long, D. D. E., Miller, E. L., Schwarz, S. J., T. J. E., and Wylie, J. J. 2008. A spin-up saved is energy earned: achieving power-efficient, erasure-coded storage. In Proceedings of the 4th conference on Hot topics in system dependability. HotDep'08. 4--4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Grupp, L. M., Caulfield, A. M., Coburn, J., Swanson, S., Yaakobi, E., Siegel, P. H., and Wolf, J. K. 2009. Characterizing flash memory: Anomalies, observations, and applications. In Proceedings of the 42nd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'42). ACM, New York, NY, 24--33. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Guerra, J., Belluomini, W., Glider, J., Gupta, K., and Pucha, H. 2010. Energy proportionality for storage: Impact and feasibility. SIGOPS Oper. Syst. Rev. 44, 35--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Guerra, J., Pucha, H., Glider, J., Belluomini, W., and Rangaswami, R. 2011. Cost effective storage using extent based dynamic tiering. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST'11). USENIX Association, Berkeley, CA. 20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., and Franke, H. 2003a. Drpm: Dynamic speed control for power management in server class disks. SIGARCH Comput. Archit. News 31, 169--181. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Gurumurthi, S., Sivasubramaniam, A., Kandemir, M., and Franke, H. 2003b. Reducing disk power consumption in servers with drpm. Computer 36, 59--66. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Gurumurthi, S., Sivasubramaniam, A., and Natarajan, V. K. 2005. Disk drive roadmap from the thermal perspective: A case for dynamic thermal management. SIGARCH Comput. Archit. News 33, 38--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Gurumurthi, S., Zhang, J., Sivasubramaniam, A., Kandemir, M., Franke, H., Vijaykrishnan, N., and Irwin, M. J. 2003c. Interplay of energy and performance for disk arrays running transaction processing workloads. In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 123--132. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Harnik, D., Naor, D., and Segall, I. 2009. Low power mode in cloud storage systems. In Proceedings of the IEEE International Symposium on Parallel & Distributed Processing (IPDPS'09). 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Hong, B., Plantenberg, D., Long, D. D. E., and Sivan-Zimet, M. 2004. Duplicate data elimination in a san file system. In Proceedings of the 21st IEEE Conference on Mass Storage Systems and Technologies (MSST'04). IEEE Computer Society, Los Alamitos, CA, 301--314.Google ScholarGoogle Scholar
  29. Huang, H., Hung, W., and Shin, K. G. 2005. Fs2: Dynamic data replication in free disk space for improving disk performance and energy consumption. SIGOPS Oper. Syst. Rev. 39, 263--276. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Irani, S., Singh, G., Shukla, S. K., and Gupta, R. K. 2005. An overview of the competitive and adversarial approaches to designing dynamic power management strategies. IEEE Trans. Very Large Scale Integr. Syst. 13, 1349--1361. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Joukov, N. and Sipek, J. 2008. Greenfs: Making enterprise computers greener by protecting them better. SIGOPS Oper. Syst. Rev. 42, 69--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Kaushik, R., Abdelzaher, T., Egashira, R., and Nahrstedt, K. 2011. Predictive data and energy management in greenhdfs. In Proceedings of the 2nd International Green Computing Conference (IGCC'11). IEEE Computer Society, Washington, DC, 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Kaushik, R. T. and Bhandarkar, M. 2010. Greenhdfs: Towards an energy-conserving, storage-efficient, hybrid hadoop compute cluster. In Proceedings of the International Conference on Power Aware Computing and Systems (HotPower'10). 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Kaushik, R. T., Cherkasova, L., Campbell, R., and Nahrstedt, K. 2010. Lightning: Self-adaptive, energy-conserving, multi-zoned, commodity green cloud storage system. In Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing (HPDC'10). 332--335. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Kim, J. and Rotem, D. 2011. Energy proportionality for disk storage using replication. In Proceedings of the 14th International Conference on Extending Database Technology (EDBT/ICDT'11). 81--92. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Kothiyal, R., Tarasov, V., Sehgal, P., and Zadok, E. 2009. Energy and performance evaluation of lossless file data compression on server systems. In Proceedings of the 2nd Israeli Experimental Systems Conference (SYSTOR'09). 4:1--4:12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Kulkarni, P., Douglis, F., LaVoie, J., and Tracey, J. M. 2004. Redundancy elimination within large collections of files. In Proceedings of the USENIX Annual Technical Conference (ATEC'04). 5. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Lang, W., Patel, J. M., and Naughton, J. F. 2010. On energy management, load balancing and replication. SIGMOD Rec. 38, 35--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Lee, H. J., Lee, K. H., and Noh, S. H. 2008. Augmenting raid with an ssd for energy relief. In Proceedings of the Conference on Power Aware Computing and Systems (HotPower'08). 12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Lee, S. and Kim, J. 2010. Using dynamic voltage scaling for energy-efficient flash-based storage devices. In Proceedings of the International SoC Design Conference (ISOCC'10). IEEE Computer Society, Washington, DC, 63--66.Google ScholarGoogle Scholar
  41. Leverich, J. and Kozyrakis, C. 2010. On the energy (in)efficiency of hadoop clusters. SIGOPS Oper. Syst. Rev. 44, 61--65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Li, D. and Wang, J. 2004a. Eeraid: Energy efficient redundant and inexpensive disk array. In Proceedings of the 11th Workshop on ACM SIGOPS European Workshop (EW'11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Li, D. and Wang, J. 2004b. A performance-oriented energy efficient file system. In Proceedings of the International Workshop on Storage Network Architecture and Parallel I/Os. 58--65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Liao, X.-L., Bai, S., Wang, Y.-P., and Hu, S.-M. 2011. Isra-based grouping: A disk reorganization approach for disk energy conservation and disk performance enhancement. IEEE Tran. Computers 60, 2, 292--304. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Lu, L., Varman, P., and Wang, J. 2007. Diskgroup: Energy efficient disk layout for raid1 systems. In Proceedings of the International Conference on Networking, Architecture, and Storage (NAS'07). IEEE Computer Society, Los Alamitos, CA, 233--242.Google ScholarGoogle Scholar
  46. Lu, Y.-H., Chung, E.-Y., Šimunić, T., Benini, L., and De Micheli, G. 2000. Quantitative comparison of power management algorithms. In Proceedings of the Conference on Design, Automation and Test in Europe (DATE'00). 20--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Manzanares, A., Bellam, K., and Qin, X. 2008. A prefetching scheme for energy conservation in parallel disk systems. In Proceedings of the International Symposium on Parallel and Distributed Processing (IPDPS'08). IEEE Computer Society, Washington, DC, 1--5.Google ScholarGoogle Scholar
  48. Mohan, V., Gurumurthi, S., and Stan, M. 2010. Flashpower: A detailed power model for nand flash memory. In Proceedings of the Conference on Design, Automation, and Test in Europe (DATE'10). IEEE Computer Society, Washington, DC, 502--507. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Narayanan, D., Donnelly, A., and Rowstron, A. 2008. Write off-loading: Practical power management for enterprise storage. Trans. Storage 4, 10:1--10:23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Narayanan, D., Thereska, E., Donnelly, A., Elnikety, S., and Rowstron, A. 2009. Migrating server storage to ssds: Analysis of tradeoffs. In Proceedings of the 4th ACM European Conference on Computer Systems (EuroSys'09). 145--158. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Okada, K., Kojima, N., and Yamashita, K. 2000. A novel drive architecture of hdd: “Multimode hard disc drive”. In Proceedings of the 18th International Conference on Consumer Electronics (ICCE'00). IEEE, Los Alamitos, CA, 92--93.Google ScholarGoogle Scholar
  52. Otoo, E., Rotem, D., and Tsao, S. C. 2009. Analysis of trade-off between power saving and response time in disk storage systems. In Proceedings of the IEEE International Symposium on Parallel & Distributed Processing. 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Papathanasiou, A. E. and Scott, M. L. 2004a. Energy efficient prefetching and caching. In Proceedings of the USENIX Annual Technical Conference (ATEC'04). 22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Papathanasiou, A. E. and Scott, M. L. 2004b. Power-efficient server-class performance from arrays of laptop disks. Tech. rep. 837, University of Rochester, Rochester, NY. May.Google ScholarGoogle Scholar
  55. Park, J., Yoo, S., Lee, S., and Park, C. 2009. Power modeling of solid state disk for dynamic power management policy design in embedded systems. In Proceedings of the 7th IFIP WG 10.2 International Workshop on Software Technologies for Embedded and Ubiquitous Systems (SEUS'09). Springer-Verlag, Berlin, Heidelberg, 24--35. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Pinheiro, E. and Bianchini, R. 2004. Energy conservation techniques for disk array-based servers. In Proceedings of the 18th Annual International Conference on Supercomputing (ICS'04). 68--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Pinheiro, E., Bianchini, R., and Dubnicki, C. 2006. Exploiting redundancy to conserve energy in storage systems. SIGMETRICS Perform. Eval. Rev. 34, 15--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Quinlan, S. and Dorward, S. 2002. Venti: A new approach to archival data storage. In Proceedings of the 1st USENIX Conference on File and Storage Technologies (FAST'02). Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Sankar, S., Gurumurthi, S., and Stan, M. R. 2008. Intra-disk parallelism: An idea whose time has come. SIGARCH Comput. Archit. News 36, 303--314. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Seagate 2000. Seagates sound barrier technology (sbt)—the art of quiet disc drives. http://www.seagate.com/docs/pdf/whitepaper/sound_barrier.pdf.Google ScholarGoogle Scholar
  61. Seagate 2010. Seagate powerchoice technology provides unprecedented hard drive power savings and flexibility. http://www.seagate.com/docs/pdf/en-GB/whitepaper/tp608_powerchoice_tech_provides.pdf.Google ScholarGoogle Scholar
  62. Sehgal, P., Tarasov, V., and Zadok, E. 2010. Optimizing energy and performance for server-class file system workloads. Trans. Storage 6, 10:1--10:31. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Seo, E., Park, S. Y., and Urgaonkar, B. 2008. Empirical analysis on energy efficiency of flash-based ssds. In Proceedings of the conference on Power Aware Computing and Systems (HotPower'08). USENIX Association, Berkeley, CA, 17--17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Shvachko, K., Kuang, H., Radia, S., and Chansler, R. 2010. The hadoop distributed file system. In Proceedings of the 26th IEEE Symposium on Massive Storage Systems and Technologies (MSST'10). 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Staelin, C. and Garcia-Molina, H. 1991. Smart filesystems. In Proceedings of the USENIX Winter Technical Conference (USENIX Winter'91). USENIX Association, Berkeley, CA, 45--52.Google ScholarGoogle Scholar
  66. Storer, M. W., Greenan, K. M., Miller, E. L., and Voruganti, K. 2008. Pergamum: replacing tape with energy efficient, reliable, disk-based archival storage. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST'08). 1:1--1:16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Thereska, E., Donnelly, A., and Narayanan, D. 2011. Sierra: Practical power-proportionality for data center storage. In Proceedings of the 6th Conference on Computer Systems (EuroSys'11). 169--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Venkatachalam, V. and Franz, M. 2005. Power reduction techniques for microprocessor systems. ACM Comput. Surv. 37, 195--237. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Verma, A., Koller, R., Useche, L., and Rangaswami, R. 2010. Srcmap: Energy proportional storage using dynamic consolidation. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST'10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Wang, J., Zhu, H., and Li, D. 2008. eraid: Conserving energy in conventional disk-based raid system. IEEE Trans. Comput. 57, 359--374. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Weddle, C., Oldham, M., Qian, J., Wang, A.-I. A., Reiher, P., and Kuenning, G. 2007. Paraid: A gear-shifting power-aware raid. Trans. Storage 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Weissel, A., Beutel, B., and Bellosa, F. 2002. Cooperative i/o: A novel i/o semantics for energy-aware applications. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02). 117--129. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Wildani, A. and Miller, E. 2010. Semantic data placement for power management in archival storage. In Proceedings of the 5th Petascale Data Storage Workshop (PDSW'10). IEEE Computer Society, Los Alamitos, CA, 1--5.Google ScholarGoogle Scholar
  74. Xie, T. 2008. Sea: A striping-based energy-aware strategy for data placement in raid-structured storage systems. IEEE Trans. Comput. 57, 748--761. Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Yao, X. and Wang, J. 2006. Rimac: A novel redundancy-based hierarchical cache architecture for energy efficient, high performance storage systems. SIGOPS Oper. Syst. Rev. 40, 249--262. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Yoo, B., Won, Y., Choi, J., Yoon, S., Cho, S., and Kang, S. 2011. Ssd characterization: From energy consumption's perspective. In Proceedings of the 3rd USENIX Conference on Hot Topics in Storage and File Systems (HotStorage'11). USENIX Association, Berkeley, CA, 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., and Wilkes, J. 2005. Hibernator: Helping disk arrays sleep through the winter. SIGOPS Oper. Syst. Rev. 39, 177--190. Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Zhu, Q., David, F. M., Devaraj, C. F., Li, Z., Zhou, Y., and Cao, P. 2004. Reducing energy consumption of disk storage using power-aware cache management. In Proceedings of the 10th International Symposium on High Performance Computer Architecture (HPCA'04). 118--129. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Zhu, Q. and Zhou, Y. 2005. Power-aware storage cache management. IEEE Trans. Comput. 54, 587--602. Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Zong, Z., Briggs, M., O'Connor, N., and Qin, X. 2007. An energy-efficient framework for large-scale parallel storage systems. In Proceedings of the International Symposium on Parallel and Distributed Processing (IPDPS'07). IEEE Computer Society, Washington, DC, 1--7.Google ScholarGoogle Scholar

Index Terms

  1. Power-reduction techniques for data-center storage systems

                    Recommendations

                    Comments

                    Login options

                    Check if you have access through your login credentials or your institution to get full access on this article.

                    Sign in

                    Full Access

                    • Published in

                      cover image ACM Computing Surveys
                      ACM Computing Surveys  Volume 45, Issue 3
                      June 2013
                      575 pages
                      ISSN:0360-0300
                      EISSN:1557-7341
                      DOI:10.1145/2480741
                      Issue’s Table of Contents

                      Copyright © 2013 ACM

                      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                      Publisher

                      Association for Computing Machinery

                      New York, NY, United States

                      Publication History

                      • Published: 3 July 2013
                      • Accepted: 1 February 2012
                      • Revised: 1 December 2011
                      • Received: 1 September 2011
                      Published in csur Volume 45, Issue 3

                      Permissions

                      Request permissions about this article.

                      Request Permissions

                      Check for updates

                      Qualifiers

                      • research-article
                      • Research
                      • Refereed

                    PDF Format

                    View or Download as a PDF file.

                    PDF

                    eReader

                    View online with eReader.

                    eReader