OracleLinuxEngineeringTeam Update

WhathasORACLEbeendoingtoLinux!?

@LUGOD 18thMay2009

ToddTrichler OracleTechnologyNetwork

Support,Comfort&ProofPoints
Yourperspectivewilldeterminehowyou valuetheimportanceofthings.

LargeScaleCustomers

Whobetasignificantportionoftheirbusiness,demand qualitysupportandsomeonetoholdaccountable. Newtechnologyprojectsoftenonlygetstarted,once peopleareconfidentofthesafetynetunderneath them. Thecostofopportunitylostinbusinessdowntimeis oftenmanytimestheinitialcostoftheinfrastructure.

Terminology

Opensourcesoftware;notanewLinuxdistribution Terminology

UnbreakableLinux=SupportProgram EnterpriseLinux=Software

TracksRedHatproductreleases Freelyavailablesourceandbinaries x86,x8664(AMDandIntel)andia64architectures MakingLinuxBetter

OneSupportCallfortheCompleteStack
7,000+supportstaff in17globalsupport centers Supportin27local languages 1.25Mservice requestsfiled electronically

400K+knowledge solutions

450Kservice requestsoverthe phone 110M+web knowledgetransfers

SoftwareChannel:UnbreakableLinux Network(ULN)

linux.oracle.com Updates,bugfixes,securityfixes AccessviaYumandWebbrowser Erratamailinglist Searchpackages Downloadpackages Binaryandsource Managechannelsubscriptions Seehowcurrentyourregistered serversare

WhatisPremierBackporting?

TraditionalBackporting=Aspecificbugfixproducedforthelatest versionofapackagemayberetroactivelycreatedandintroducedaspart ofanearlierreleaseorupdatelevel(e.g.abugfixreleasedinRHEL5or

OEL5isalsoreleasedaspartofRHEL4orOEL4)

OnlyOracleoffersPremierBackporting,whichgoesfarbeyond traditionalbackporting.Forexample: CurrentuserrunsRHEL4orOEL4Update4release; Whenupdate5becomesavailable,theywanttostayonUpdate4 andgetjustonespecificbugfixinUpdate5backportedtotheir currentenvironment; WithPremierBackporting,Oraclemakesthatspecificbugfix availablewithoutforcingthecustomertoupgrade; Insharpcontrast,aRedHatsupportcustomermustupgradetothe entireUpdatereleasetogetjusttheonebugfixtheyneed.

NopressuretoupgradetothelatestUpdaterelease

ComprehensiveIndemnification
Indemnificationforintellectualpropertyclaims

raisedagainstourcustomers
AvailabletoallOraclesupportedcustomers

Network,BasicandPremier Includesdamages,liabilities,costsandexpenses awardedbycourts

Notlimitedtotheamountofmoneypaidby thecustomer DeployLinuxwithConfidence

Now,backtotheoriginalquestion...

WhathasORACLEbeendoingtoLinux!?

Quitealot...

Source:JonathanCorbet'sarticle,March18th2009 http://lwn.net/Articles/324046/

Code,Commitment&Contributions

Clustering

DataIntegrity

OCFS2 T10Dif

Stability&Performance

NUMAawaresemtimedop Automatedkerneltesting KthreadbackedAIO IOqueuingandcompletionaffinity CFQIOcontextsharing Realtimeschedulerenhancements

Code,Commitment&Contributions

Stability&Performace

FileSystemImprovements

SSDsimulationandtuning RDSReliableDataStreams NFSIpv6 Btrfs CRFSCoherentRemoteFileSystem PVNetworkingdriverforwindows PVHugepages LoopimprovementsforXenimages JeOSJustEnoughOS

Virtualization

Code,Commitment&Contributions

OracleVMServeraXenbasedvirtualization environment.

AllfixescontributedbacktotheXencommunity
FreelyavailablesourceandISO's

OpenSourceProjects

Assistinternalteamswithkerneldebuggingandtuning RunvisiblemainlineprojectsthatimproveLinuxforall workloads DevelopspecificfeaturesforOracleproducts Participateheavilyinthekernelcommunity.

OCFS2Clustering
OracleClusterFileSystem2wasthefirst generalpurposeclusterfilesystemtobe addedtothemainlinelinuxkernel(2.6.16). Supportfor3rdpartyclusterware ApplicationslikeOracleRACandOracleVM, canleveragetheadvancedfeaturesinOCFS2 Nextsteps

Addadditionalfeatures,thatwillmakesnapshotingin virtualizationenvironmentseasier. CheckoutWim'sblogentryonOCFS2_reflink

Source:WimCoekaert'sblog,May4th2009 http://blogs.oracle.com/wim/2009/05/ocfs2_reflink.html

T10DifDataIntegerity
FirstLinuximplementationofT10standardfor endtoendchecksummingdonebyOracle. Solvestheproblemofonlyfindingoutifyour backupisgoodwhenyougotorestore.Very valuableforsupercriticalsystems. http://oss.oracle.com/projects/dataintegrity/ Nextsteps

TestwithearlyimplementationsfromLSIandothers Getcodeintomainline

NUMAAwareSemtimedop

NUMAawareimplementationofsemtimedopgreatly reduceslockcontentiononlargemachines.Memory allocationoptimizations,veryimportantforlarge systems. Patchimprovesperformanceby18%,butweneeded 50%tomatchnanosleephotfix Nextsteps

TunepatchbasedonIntelperformancedata Porttomainline

SolidStateDiskSimulationandTuning
SSDdeviceswillsoonexposebottlenecksinIO subsystemsastheiops/secincrease SimulateanSSDdevicebyconnectingtwo Marvelsatacardsintwomachines.Host memoryononemachineisusedtosimulatea drive Detectwhetherstorageisflashorspindle allowsforintelligentuseofstoragebyapp. NextSteps

Finishdriverupdatestoenablethesatahostmode Benchmark&Sendfixestomainline

Infiniband&ReliableDataStreams
ThroughtheReliableDataSreamsworkwe havedonealotofbugfixingonthegenericlinux infinibandstack(ofed)butalsofullyimplemented theRDSdriver,andthisdriverisbothincore linuxandintheofed(bsd)OSvendorneutral stack. WearemaintainersofRDS. EventhoughRDSisusedbyOraclein Exadata,itisnotoraclespecific

IOLayer
MaintainershipforLinusoftheLinuxblockIO layer. Lotsofworkonperformanceenhancements. Totallynewlinuxblockiocodewrittenby Jens.(2.6) AsyncIOchangesforintensiveoperations, standardAIOusedbyprettymuchevery database(oracle,db2,msqletc.) LinuximplementationforO_DIRECTwas doenbyOracle.

IOAffinity
FrameworktoforceIOcompletionontothe sameCPUthatstartedtheIO Cansignificantlyreducelockcontentionand cachelinebouncing,improvingNUMA performance,justforlargecpusystems. Status:earlyimplementation Nextsteps

Gatherperformanceresultsandtunethepatches(HPis benchmarkingonlargehardware)

Source:JensAxboe'sblog,Jan19th2009 http://axboe.livejournal.com/1718.html

GCCandlibstdc++
CompletedimplementationofUTF16and UTF32supportingcc WorkwiththenewGNUlinker(Gold) UseOracleproductstodocompilertesting Restructuringdebuginfoproject libstdc++upstreammaintainership performanceanalysisofthelowlevelIO libraries

NFSLayerstatdandNFSIPv6
ComaintainertogetherwithTrond(Netapp) Alargecollectionofchangesrequiredto enableNFSandRPConIPv6 IPv6exportaccesscontrol,anduserlevel commandupdates. Ipv6supportisimportantforgoverments Status

Infinalstages,mostpatchesalreadyincludedin mainline NFStestingandinteroperabilityrequirements(Bulland Netapparedoingthetesting)

Btrfs

HailedbyLinuxkerneldevelopersas TheNextGenerationFileSystem
includedin2.6.29kernel

Copyonwritefilesystemwithsnapshotting andchecksumming Designedforrepairandreliability Manyfeaturesthataredifficultorimpossible withtoday'sfilesystems Includesflexiblestoragemanagementacross multipledevices http://btrfs.wiki.kernel.org/

CRFS
CoherentRemoteFilesystem NetworkfilesystemusingtheBtrfsdiskformat LocalcachingwithPOSIXsemantics AimedatthemostcommonNFSusecases ProtocolsendsBtrfskey/valuepairsoverthe wire,makingitidealforsynchronizingtwo Btrfsfilesystemsaswell MayclusterenabletheBtrfsvolumemanager

VirtualizationInfrastructure

ServerConsolidation

ServerConsolidationisveryGreen$$$$

OracleVMServer

OpenSource,FreeDownload, FreelyDistributable

OracleVMManager

Browserbasedmanagementsolution IncludedwithOracleVM FullVMlifecyclemanagement:

Create Configure Clone Share Boot Migrate

FreeDownload, Freely Distributable

OracleVM
Oracle Database
Oracle EnterpriseLinux

Fusion Middleware
Oracle EnterpriseLinux

Oracle Applications
Oracle EnterpriseLinux

NonOracle Applications
OracleorRedHat EnterpriseLinux

NonOracle Applications
Microsoft Windows

OracleVM

Oracletestedandsupportedservervirtualizationtechnology MaximizesconsolidationofLinuxandWindowsservers Savesonpower,coolingandspace

JeOS

JustenoughOSisasecure,minimizedOSthatis freelyredistributableandbackedbyenterpriseclass supportdevelopersandISVscannoweasilybuild OracleVMTemplates. WithOracleEnterpriseLinuxJeOS,anyonecanput theirapplicationsontopofasmallfootprint, enterpriseoperatingsystemandbuildafullstack virtualmachineorOracleVMTemplate.Theresulting OracleVMTemplateisfreelyredistributable,without triallicenserequirements,andisbackedby enterpriseclasssupport.

OraclesContributions

EnhancedandoptimizedXentechnology

I/Ooverhead Memoryoverhead(also...tmemcomingsoon) ProcessScheduling DedicatedXendevelopmentteam CodeandbugfixcontributionstoXencommunity MembersofXencommunityatOracle MemberofXenSummitcommittee RealworldtestingwithOracleOnDemandworkloads TestingwithOracleValidatedconfigurationworkloads

Communityinvolvement

Significanttesting

OraclesInternalUsage
OracleVM

OracleVMwidelydeployedacrossOracle

AsofDec2008

ProductDevelopment,Test,QA OracleUniversityspublictraininginfrastructure OracleOnDemand: Oraclessubscriptionandmanagedapplications business 1,000+OracleVMServers 6,500+guestVMs EnterpriseLinuxandWindows

Stillaggressivelyrollingacrossthecompany

Expecttoincreaseby2X+bymid2009

Thanks&Resources

http://www.oracle.com/technology/products/vm/index.html

http://linuxfestnorthwest.org/slides2009/oracle.pdf

http://otn.oracle.com/linux

http://oss.oracle.com

@LUGOD 18thMay2009 Solong,andthanksforthefish Credits:AdamHawley,DanMagenheimerandWim Coekaertsforallowingmetoblatantlyplagiarizepartsof theirrespectivepresentations. Remember:reuseisatthecoreofvirtualization