Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

(1)

(2)

B6478 - Fast, flexible, and

scalable: Efficient Web hosting on

Moonshot

Volker Otto & John MacLennan / 2 December 2014 #HPDiscover

(3)

Please give me your feedback

Session B6478 Speaker Volker Otto / John Maclennan

Use the mobile app to complete a session survey

1. Access “My schedule” 2. Click on this session 3. Go to “Rate & review”

If the session is not on your schedule, just find it

via the session scheduler, click on this session and then go to “Rate & review”.

Thank you for providing your feedback,

(4)

Web Hosting at HP

Public Cloud

HP IT

Hosting Services for Enterprise customers

Managed Hosting Solutions using HP Infrastructure

Dedicated Hosting Solutions providing platform services on premise, or in an HP data center

HP Enterprise Services

Hosting Provider for HP’s application portfolio

Hosting Platform provided in dedicated data center space Platforms supported

• HP-UX • Linux • Windows

End Customer focused hosting solutions utilizing the HP Public Cloud

(5)

Web Hosting at HP IT

• HP IT is the hosting provider for HP Business applications

• Hosting platform provided on HP-UX, Linux and Windows out of six data center locations in the US

• Web farms available for internal, extranet, and internet-facing applications

• Platform solutions range from virtual machines to shared farms to

dedicated server environment setups, including Moonshot

(6)

Optimize your application performance

HP Moonshot System

Accelerate business innovation

Enabling you to be more competitive

A system that truly fits the workload it is running

Realize breakthrough economics

Redefining the economics of your data center

(7)

HP.COM Landscape and Hosting Models

HP’s web experience is comprised of 1000s of web assets, created by numerous industry-standard and business specific applications

• Brand and Corporate level web sites • Marketing and product information • Online stores

• Channel partner

• Support (Consumer, Business, Drivers and downloads, etc..) Moonshot usage focused on

• Robust setup with fine-grain load distribution and traffic management

(8)

HP.COM Current Moonshot Usage

HP’s Web Gateway :

(9)

The HP Web Publishing Solution

(HPWPMX)

(10)

Our legacy HPWPUX

• www.hp.com, partner.hp.com, ftp.hp.com examples for large, dedicated hosting environments

• Shared hosting services established in parallel to serve smaller web sites w/o dedicated environment • HP W(eb) P(ublishing) environments available for HP-UX and Windows

• HPWPUx selected as a good candidate for Tech Refresh using Moonshot • Represents about 50 php/Oracle applications in a multi-tenant environment • Base stack: Apache/PHP/Oracle, migration to LAMP ideal

• Technology utilized

– Sitebuilder*

– Repliweb

– HP-UX

– PHP

– Oracle User manually

creates content Content uploaded and reviewed in SiteBuilder App

Content published to hosting farm

(11)

Our Digital Authors … Customers of HPWPMX

• Diverse group:globally dispersed, whole spectrum of technical (web) competence, many organizational backgrounds within HP and its agencies

• Shared needs:simple web authoring and publishing, minimal learning curve, fast initial results, room to grow and evolve their web presence over time.

• Meet all of HP‘s standards, but keeping it quick and simple:

– Log into the HP network and access the web user interfaces

– Upload their existing work, refine/test/review with stakeholders within HP – Publish it online and see the results

– „Request to Live“ measured in days or even hours especially for marketing

• Some of their work

– http://engineeredby.hp.com/michael-bastian/index.html – http://h71044.www7.hp.com/SAW/

– http://www.hp.com/make-it-matter/us/en/ – http://www.hp.com/go/worldtour

(12)

The Opportunity

The availability of the Moonshot platform and resulting consolidation projects presented the chance to review and refresh the Shared Web Hosting experience by evaluating

Our customers

• The digital authors:

– HP business users and web developers, plus contracted web agencies

– A solution with a low learning curve using existing tools and industry standard web technologies

– Without the overhead of learning to manage and support any (traditional, IaaS, PaaS) hosting

• Business stakeholders:

– Needing fast turnaround to meet business needs, especially in marketing

– Needing low cost for good project ROI

Our competition

• Traditional HP IT delivery model

– challenged to meet the pace/demands dictated by Industry and the Web today for web hosting

• Omnipresent external (Cloud) offerings everywhere

(13)

The New HPWPMX

• First Shared Hosting Service to utilize Moonshot server farms • Migration/transformation challenges:

– 7 year difference in business and technology thinking

– Migration to utilize the latest HP IT services, including HP Private Cloud (Oracle to Cloud MariaDB port), Object Storage etc..

– Scale out: Moving from ~10 Itaniums servers to 180 cartridges – from one PRO farm to three PRO farms

• Managing a extensively scaled out environment

– Build automation: Ansible to automate the build and configuration of the OS and middleware components.

– Configuration Management: Ansible together with GIT giving administrators a more robust, repeatable, and automated way of

managing “infrastructure as code” (a core tenant of the DevOps philosophy).

– Monitoring and Control (MAC): Monit for process supervision and control, an ElasticSearch ELK* stack (ElasticSearch+Logstash

+ Kibana ) for log centralization and analysis, and Graphite for metric collection and display.

(14)

The Webfarm Summary

From HPWPUx To HPWPMx

Itanium Moonshot

HP-UX Linux

Apache Varnish / Apache

PHP PHP No local data store GlusterFS, Couchbase No remote data store

MongoDB, Object Storage

Oracle MariaDB

No build automation

Ansible

Minimal server

up/down response Per service monitoring and control with

• MMonit

• ElasticSearch/Logstash/ Kibana

(15)

The End to End Configuration Highlights

• Vhosts

– Using Apache’s ‘dynamic virtual hosting’ to host multiple

unique sites independently

– Content publishing simply needs to publish content in a

directory of the same name as the website, and it can be browsed immediately without the need for any further configuration or restarting of services

– The host header of the incoming request allows Apache

to determine which website (content) to return • Hosting specific settings (e.g. database connection

strings, web proxy settings, etc.) are abstracted out into variables defined in separate configuration files • Configuration files and content for the sites are

managed through SiteBuilder

• SiteBuilder uses rsync replication to ensure the correct content is published in a controlled manner;

relieves HP IT from all user administration on the

HPWPMx environment, and ensures user audit compliance.

• HPWPMX Hosting setup:

– 3 production farms using 40 per farm = 120 servers

– 6 additional slave servers per production farm (for

continual security scanning) = 18 servers

– 1 ITG farm for HPWPMx configuration testing etc.. =

16 servers

– Remainder for growth based on demand = 26 servers

Users SiteBuilder App HPWPMx hosting farm

(16)

How HPWPMX Works Operationally

• Built for about 600 Website publishers (HPWPMX users) from the non-technical to the tech-savvy • Although requested, full access to the hosting site is not desireable ,180 servers would be hard to

manage, a major risk to stability and audit compliancy would be impossible • Solution: Provision Access via browser based tools

– File Content

• Publishing the website content and application files is done via HP‘s internal SiteBuilder application = web based explorer UI with user management and limited publishing workflow = simple and transparent sandboxed process per website

• Shared (GlusterFS hosted) file content is managed via the internal administration webservers, as the website publishers see fit. Each website has its own sandboxed directory.

– Database

• MariaDB is managed via PhpMyAdmin – where each website has one database given to website publishers by default

• Couchbase‘s own admin UI is available - for NoSQL databases and distributed cache capabilities provisioned on demand for those websites which need it.

– Environment

• Database server connections, load-balancer details etc. values are abstracted into php variables for website publishers to use in their code – result is cleaner code, which is independent of underlying web hosting instances (no more test to

production website breakages).

 Empty website setup pre-provisioned by HPWPMX Environment Operations in approx. 2h Users SiteBuilder

(17)

How HPWPMx Works – Customer browsing

• Websites are given an individual hp.com DNS CNAME

– formatted as an h4XXXX.www4.hp.com „licenseplate“ – aliased to the CNAME of the global

load-balancer above the HPWPMx webfarm

– Urls can be structured to go via Akamai, or directly to the licenseplate

– *.www4.hp.com throughout means all can leverage the *.www4.hp.com wildcard SSL certificate

• Visitor request is routed to the Varnish caching layer allowing potential local caching • Then down to the Apache layer (for the response), which

– Has a dynamic virutal hosting configuration (resolving CNAME/hostname to website) – Runs the CA SiteMinder web agents controlling authentation as needed

– Does classic static content hosting – Runs php

• For application functionality

• which is able to connect to the various data-sources;

– local MariaDB, local Couchbase, Cloud MongoDB services etc.

– Local GlusterFS shared file storage mounted to each Apache,

– Linux Shared File Storage and Cloud Object Storage availble as services within the datacenter.

– Logs the request which is immediately shipped to the central Redis/ElasticSearch/LogStash/Kibana – Provides localized (e.g. 5xx) error responses pages in hp.com design if needed

– Routes 404 responses to central redirection solution used to preserve customer browse experience.

• Administering the above data sources is done via similar

CNAME/load-balancer/Varnish/Apache architecture accessible only via the HP Intranet, by website publishers and HP business users.

• Mmonit and Grafana web interfaces restricted to HPWPMx Environment Ops and Support available

(18)

The Benefits

HP infrastructure + Open Source + hp.com expertise = an effective, feature rich web hosting environment.

The innovation in bringing these ingredients together goes beyond simple IaaS and PaaS to deliver an end-to-end web publishing/hosting solution for business. This solution is characterized by:

1. “The ability to deploy a website in 2 hours from request” – DevOps style, low-touch effort for HP IT, means rapid website deployment to meet extremely the short marketing lead-times.

2. “Business self-service” – as well as easy SiteBuilder publishing, HPWPMX remotely exposes everything from per cartridge resource usage, to php errors, to per website traffic in near real-time. Such transparency allows users to self-monitor and self-diagnose many issues without resorting to IT support.

3. “Easy website lifecycle management” – ease of website creation means the ease to have many websites, and hence all can more tightly manage the content and lifecycle for these smaller websites.

4. “Optimized footprint” – using Moonshot cartridges allows the whole farm setup to run within 1 rack per data center (2 rack total), with a power consumption of approx. 4kW for the four chassis

(19)

Current Status

• HPWPMX deployed in 2 HP-IT data center, using 4 Moonshot Chassis with Borman 1 cartridges • Logical setup: 1 Integration Testing Farm, 3 Production Farms

• Production Farms consist of identical stacks in two data center, per DC

– 4 Varnish cartridges – external facing

– 8 Apache cartridges – external facing

– 2 Gluster cartridges

– 2 Couchbase cartridges

– 2 Apache cartridges – internal facing

– 2 Varnish cartridges – internal facing

• Total farm build out

– 156 cartridges with room to grow

– Will host approx. 60 to 80 web sites in a site-to-site configuration

D

(20)

Outlook

• At the most simple level, HP IT are challenged to maintain stability and reliability in the face of ever greater rates of business change, which hp.com must continue to successfully reflect.

• Historically we could get at least 5 years of operation from of a web-hosting farm. We do not want to change the ROI and stability that comes with that.

• HPWPMX as a solution meets:

– Ability to adapt to changing business needs,

– Maintain a stable infrastructure with an operationally feasible upgrade path

• HPWPMX is not an answer to every webhosting demand, our focus in the next phase of activity will be on:

– Examine the latest leap of Moonshot cartridges; can it meet our ever-increasing needs (storage & bandwidth)

– Examine the adaptation of an HPWPMX-style model to a Windows (.NET application) hosting stack

– Qualification of HP software solutions, e.g. HP Autonomy and Big Data, to run natively on Moonshot

– Moonshot integration into the HP Cloud Solutions (CSA and Helion)

• HPWPMX represents one step on a continual journey to create HP on HP solutions, using our technology and evolving expertise, to meet our business needs

(21)

(22)

For more information

Attend these sessions

• DT6504, Transform advertising at the point of sale – Jingit and HP Moonshot unite brands,

consumers, retailers and

payments in real time. Tue,

4:30pm

• DT6506, Swoop and HP Moonshot – Delivering a powerful search and analytics engine to simplify transformation of Big Data into

actionable intelligence. Thurs,

10:30am

Visit these demos

• HP IT Guru Bar: How HP runs on HP, 6135

• HP data center network fabrics: It's time for a new data center network, 5754

• HAVEn in HP IT: Managing our Big Data environments, 5921

• HP Education Services: Cloud-based collaboration and training, 5634

After the event

• Contact your sales rep

• Watch replays of HP Discover at: www.hp.com/go/discover

• Visit the HP Moonshot website at hp.com/go/moonshot

• Visit the HP Private Cloud website at

hp.com/go/privatecloud

Your feedback is important to us. Please take a few minutes to complete the session survey.

(23)