Implementation of Cloud Storage System using Multiple Cloud Services

(1)

International Journal of Emerging Technology and Advanced Engineering

Website: www.ijetae.com (ISSN 2250-2459,ISO 9001:2008 Certified Journal, Volume 5, Issue 9, September 2015)

119

Implementation of Cloud Storage System using Multiple Cloud

Services

Sarang Mandloi

1

, Priya Saxena

2

1

Research Scholar, Department of Computer Science & Engg., Sanghvi Innovative Academy, Indore, M.P, India 2_{Assistant Professor, Sanghvi Innovative Academy, Indore, M.P, India}

Abstract— With rapid development of cloud computing,

data storage space requirements from end-users are increasing, demanding additional capacity, extra reliability and the capacity to access information from everywhere. Storage layer is the most basic part of the cloud storage. Cloud-based storage management is the core part is stored in the cloud part of the most difficult to achieve. In this paper we describe an efficient cloud storage model for heterogeneous cloud services.

Keywords—

computing, cloud storage, cloud services.

I. INTRODUCTION

Cloud computing has grown an adoptable technology for many of the organizations which consists of dynamic scalability and entry to virtualized resources being a service with the Internet [1]. Impair computing, as an emerging calculating paradigm, enables customers to remotely shop their data inside a cloud, so as to enjoy solutions on-demand. Impair calculating identifies a brand new Internet-based that solutions to raise the particular use in addition to distribution model, typically concerning the World-wide-web to deliver energetic in addition to scalable and infrequently virtualized resources [2]. Fig. 1 indicates the particular construction associated with impair calculating. Impair will be the huge calculating system automatically split into a lot of scaled-down subroutines, in addition to then by means of multiple server techniques composing of a substantial lookup, computation in addition to evaluation after the outcomes back towards consumer. With this technology, the particular remote control supplier can certainly throughout a few seconds to achieve tens associated with thousands as well as handle huge amounts of us dollars associated with data for you to and the "super computer" the same highly effective effectiveness associated with system solutions [3]. It is going to likely employ a major impact on the particular large storage space later on. Nowadays, the phrase ―cloud computing‖ may be a vital period on earth associated with IT.

Figure1:Cloud Computing

Deployment type along with solitude quantities, clouds can be grouped into the next several different types:

§ Public Cloud: A new general public cloud can be a cloud that will it is commercial infrastructure is usually distributed simply by many mutually untrusted impair shoppers.

§ Private Cloud: Should the commercial infrastructure of any impair is usually specialized in a certain corporation, we all talk about that will impair being a individual cloud. A personal cloud can be about or maybe away from premise.

§ Community cloud: Community clouds are usually clouds that will their particular companies are usually available with a unique number of businesses which usually kind a residential district. Community clouds can many become about or maybe away from premises.

(2)

International Journal of Emerging Technology and Advanced Engineering

120 II. LITERATURE REVIEW

Cloud computing is some sort of computing and that is highly scalable and use virtualized resources that will be shared because of the users. Cloud Computing currently is one of the new technological know-how trends will likely have a new significant have an effect on mass storage space[4][5]. Many in the previous work in the field of cloud computing are in the elements of new engineering, general explanation in the cloud technological know-how, differences involving similar engineering, security requirements as well as the future targets in these kind of emerging conditions. Different functions have planned distributed data Storage infrastructures, a number of built with grid infrastructures [6]. In [7]storage systems centered on reaching this specific theoretical limit by evening out costs involving peers and designing redundancy schemes capable to provide far better communication-storage trade-offs. In [8] regarded node heterogeneities inside grid storage space systems.

2.1 A System to Aggregate Multiple Heterogeneous Cloud Services’ Storage:

By Guilherme Sperb Machado et. al. [IEEE-2013] Platform-independent cloud Storage System for Multiple-Usage defines any novel storage overlay aggregating heterogeneous cloud storage services, supporting both generic along with data-specific storage program types. For data-specific cloud storage services deficiency of data validation is exploited to produce a generic storage devices service. Platform-independent Cloud Storage devices System for Multiple-Usage comes with a single interface to finish users enabling storage devices and data discussing.

2.2 Toward Privacy-Assured and Searchable Cloud Data Storage Services:

By Ming Li,et. al. [IEEE-2013] In this article, we identify the situation and challenges connected with enabling privacy-assured searchable cloud data storage products and services. Recent research advances on this field are surveyed, which claim that achieving functionally abundant, usable, and efficient search on encrypted data can be done without sacrificing privacy guarantee an excessive amount. The steady evolution of this field should bring expertise from the cryptography, database, as well as information retrieval towns.

2.3 An Efficient Cloud Storage Model for Heterogeneous Cloud Infrastructures:

By Dejun Wang [ELSEVIER-2011] Cloud storage system with traditional storage systems, has the following differences:

Very first, from the functional demands, cloud storage systems for many types of network online hard drive services, such as standard storage system is designed for high performance processing, transaction processing apps;

Second, the demand from the performance point of view, you first need to consider cloud storage service is data security, reliability, efficiency and other indicators, and because large-scale users, services a wide range of complex network environment, etc., to achieve high-quality cloud storage services will face greater technical challenges;

Third, from data management perspective, cloud storage system must not only provide the traditional POSIX-like file access, but also to support the massive data management, and support the provision of public services function to facilitate the background cloud data storage system maintenance.

III. CLOUD STORAGE

A lot of the cloud computing commercial infrastructure is transmitted via a reliable data services and build different levels on the server visualization technological innovation, consisting of. It could be any place to deliver network infrastructure to use these services[9]. "Cloud" usually offers the computing needs of all users a individual access point.

Cloud storage technique architecture model contains four layers.

(1) Storage space layer: Storage layer is the standard part of the actual cloud storage. FC storage devices can be Fiber Channel storage devices can be IP NAS and also storage devices, and so forth., can also be considered a SCSI or SAS storage devices including DAS. Cloud storage can be a huge number involving storage devices as well as the distribution of a variety of regions, each various other through wide location network, Internet or FC Fiber Funnel networks together.

(2) Basic management: Cloud-based storage management may be the core part is stored inside cloud part of the most difficult to accomplish. Based management from the clusters, distributed report systems and grid computing technology, cloud storage among multiple storage devices to work together, so that several storage devices start to provide a similar service, and to deliver bigger and more powerful better data gain access to performance.

(3)

International Journal of Emerging Technology and Advanced Engineering

121 (4) Access layer: Any authorized user by way of a standard application program to log open public cloud storage technique, enjoy cloud storage devices service. Different running units of foriegn storage, cloud storage to deliver access to various sorts and access strategies. Through the user access layer, any authorized user can at any place, using a networked airport terminal device, according for the standard application program to log open public cloud storage program, enjoy cloud storage devices service.

IV. PROPOSED SYSTEM

Proposed System consist following steps to aggregate cloud services storage and upload files:

1. Encryption

2. File Fragmentation, 3. Managing Index 4. Data uploading process 5. MD-5

6. Cloud services for data storage

File Fragmentation: The key advantages of experiencing the fragmentation step are: (1) send out file parts to many CSs worldwide, being managed within an overlay; (2) 1 entity (CS) struggles to reconstruct the whole file info, enabling an increased degree involving privacy; and (3) an error correction program code (e. gary., Reed Solomon) could be applied intended for data redundancy. Lower than replacement running the particular encoding step is that data could be stored anywhere, even if CSs demand file type restrictions. It enables the particular aggregation involving CSs’ safe-keeping: all CSs keep data, in much the same, independently involving file type restrictions.

Managing Index: The index information, which holds the metadata about files, e.g., in which Cloud Service the file was stored, how the data was encrypted, how the file was split into several small chunks, and how the data was encoded into other file types.

Data Uploading Process: After manage index of file. Files are uploading on different cloud services like Google drive, Amazon, Drop Box [10] and sound cloud [11].

Cloud Services for data storage: Initial, user absolutely essential register CSs’ references for his personal make use of. Assuming in which Google Picasa, Sound Cloud, Drop box, and Facebook or myspace credentials [12] tend to be registered while using the Application; the fragmentation process has the capacity to calculate in to how many report parts your PDF X could be split good maximum upload size of every CS [13]. In this specific use case the assumption is that your PDF Times is split into report parts.

[image:3.612.339.559.226.498.2]

We will develop our project with help of open stack cloud, first we will create account on open shift then create an application with the help of eclipse, jboss server, mysql .we create different type of cloud services like doc and audio for storage all the file one store in cloud server use will any different name to the different cloud services name as cloud services.

Figure 2.Proposed System

The Proposed System key consists out of information entity of the projected System file upload process result and contain all parameter necessary to find and rebuild a file within the Proposed System. Three independent top level entities in proposed index: the file, Credential and part information. Only with all three entities the Developing Application can be search all resultant file parts and can reconstruct into original file.

(4)

International Journal of Emerging Technology and Advanced Engineering

122

V. IMPLEMENTATION

Proposed System has been implemented with the help of public cloud (Red hat-Open Shift).Following step we performed for create cloud:

 Create account on open shift

 Create an application using OpenShift Dashboard .application include

o JBOSS application Server

o MYSQL 5.5 Database Server

o PHP my admin 4.0

 Mapping this Application with Eclipse (Kepler)

 After Mapping we perform all the functionality of proposed system

o Encryption

o File Fragmentation,

o Managing Index

o Data uploading process

o MD-5

[image:4.612.48.296.180.586.2]

o Cloud services for data storage

Figure: 3. Application Description on open shift cloud

Figure 3 describe application details of cloud which is created by us. Reaming functionality perform using language JAVA/JSP/Servlet.

We create heterogeneous following clouds services for data storage



http://project-sarangmtech.rhcloud.com/ServerGmail



http://project-sarangmtech.rhcloud.com/ServerDropBox



http://project-sarangmtech.rhcloud.com/ServerAmazon

VI. RESULT

Results are measured and analyzed on above factors and compared with traditional and other available systems. Several tables and graphs are shown by which effective comparison can be made on different views which strongly confirms the applicability of suggested approach.

Table 6.1:

Active User Details on public cloud

S. No UserID UserName

1 Sarang123 Sarang

2 mtech123 mtech123

Fig.4 Activate user on public cloud

[image:4.612.325.560.311.542.2]

(5)

International Journal of Emerging Technology and Advanced Engineering

123

Fig.5. Uploading process of file in to cloud

Table 6.2 show how much time needed for uploading different-different file size on cloud.

Table 6.2:

Files and their Encryption time

File Name File Size (in KB)

Encryption Time (in millisecond)

(RSA)

Test1.txt 32 135.0

Test2.txt 81 184.0

Test3.txt 151 704.0

Fig.6. File details with their status

Table 6.3:

MD5 value for each File Fragments

S. No Generated Hash value

File 1 27973765894549

File 2 40686916802697

File 3 27973765898353

In table 6.3 describe about the Digest the file fragments using the algorithm MD5.each file fragments contain different type of hash value.

VII. CONCLUSION

Cloud computing for exciting development can be a significant alternate today’s educative perspective. Cloud storage is not only just storage, far more applications. Applications stored inside the storage product is a built-in application software package functions associated with storage, which besides has information storage capabilities, also has the application software package functions, can be seen as an accumulation servers as well as storage products.

REFERENCES

[1] Guilherme Sperb Machado, Thomas Bocek, Michael Ammann, Burkhard Stiller ―A Cloud Storage Overlay to Aggregate Heterogeneous Cloud Services‖ 38 Annual IEEE conference on local computer network 2013

[2] Ming Li, Utah State University Shucheng Yu, University of Arkansas at Little Rock Kui Ren, University at Buffalo Toward Privacy-Assured and Searchable Cloud Data Storage Services 2013 IEEE IEEE Network • July/August 2013

[4] Guilherme Sperb Machado, Thomas Bocek, Michael Ammann,

Burkhard Stiller ―PiCsMu: A System to Aggregate

MultipleHeterogeneous Cloud Services’ Storage‖ 38 Annual IEEE conference on local computer network 2013

[5] Amazon.com Web Services: Products and Services. Available at: http://aws.amazon.com/products. Last visited on: March 2013. [6] Dropbox: Dropbox Service. Available at: dropbox.com. March 2013. [7] Google Corporate: Google Products and Solutions. Available at:http://google.com/intl/en/about/products/. Last visited at: March 2013.

[8] ID3 Website: ID3 Version 2 Standard. Available at: id3.org. May 2013.

[image:5.612.49.295.132.295.2] [image:5.612.48.294.367.653.2]

(6)

International Journal of Emerging Technology and Advanced Engineering

124

[10] V. I. Levenshtein: Binary Codes Capable Of Correcting Deletions,Insertions And Reversals. Soviet Physics Doklady, Vol. 10, No. 8,February 1966, pp. 707-710.

[11] Microsoft: SkyDrive, Files Anywhere. http://skydrive.com. March 2013.

[12] OAuth Specification: OAuth 2.0 Specification. Available at:http://oauth.net/2. Last visited on: March 2013.

[13] Otixo: All Your Cloud Files from a Single Login. Available at:http://otixo.com. Last visited on: March 2013.

[14] PiCsMu Website: Platform-independent Cloud Storage System forMultiple Usage. Available at: http://www.pics.mu , May 2013. [15] SalesForce.com: The Leader of Customer Relationship

Management(CRM) and Cloud Computing. Available at: http://www.salesforce.com.Last visited on February 2010.

[16] Broberg J, Venugopal S, Buyya R. Market-oriented grids and utility computing: the state-of-the-art and future directions.Journal of Grid Computing 2008, 6(3):255–76.

[17] Open Grid Forum. Cloud Storage for

CCSN.http://www.snia.org/CloudStorage For Cloud Computing .pdf.2009.

[18] Erickson, J. S., Spence, S., Rhodes, M., Banks, D., Rutherford, J., Simpson, E., et al. Content-Centered Collaboration Spacesin the Cloud. IEEE Internet Computing, 2009, 13(5), 34-42.

[19] Grossman, R. L., Gu, Y. H., Sabala, M., & Zhang, Theory Methods and Applications, 2009, 25(2), 179-183.