tag:blogger.com,1999:blog-363491442024-03-13T00:25:53.015+00:00Donal Daly on Big Data AnalyticsRandom thoughts on Big Data Analytics and the Big Data Marketplace in GeneralAnonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.comBlogger29125tag:blogger.com,1999:blog-36349144.post-12141459046269366662012-12-15T11:26:00.000+00:002012-12-15T11:26:19.680+00:00Running Teradata Aster Express on a MacBook ProTo those people who know me, know that I am complete Apple geek. Teradata's supports BYOD, so naturally I have a MacBook Pro. Why wouldn't I want to run Aster Express on it :-)<br />
<br />
The configuration was surprisingly easy once I worked out how!<br />
<br />
<h2>
<strong style="line-height: 13.5pt; text-indent: -18pt;"><span lang="EN-US" style="font-family: Calibri; font-size: 11.0pt; mso-ascii-theme-font: minor-latin; mso-bidi-font-family: Calibri; mso-bidi-theme-font: minor-latin; mso-hansi-theme-font: minor-latin;">Prerequisites</span></strong></h2>
<div style="text-indent: 24px;">
</div>
<ul>
<li><span lang="EN-US" style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">4 GB memory - (I have 8GB in mine)</span></li>
<li><span style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">At least 20 GB free disk space</span></li>
<li><span style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">OS: I am running Mac OS X 10.8.2</span></li>
<li><span lang="EN-US" style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">VMware Player</span><span lang="EN-US" style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">: - Buy VMWare Fusion. I have version 5.0.2 (900491)</span></li>
<li><span style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">** Make sure to order the professional version, as only this version has the new</span></li>
<li><span style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">** </span><b style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;">Network Editor</b><span style="font-family: inherit; line-height: 13.5pt; text-indent: -18pt;"> feature</span></li>
<li><span lang="EN-US" style="font-family: inherit; text-indent: -18pt;">7-Zip</span><span lang="EN-US" style="font-family: inherit; text-indent: -18pt;">: To extract (or uncompress) the Aster
Express package.</span></li>
</ul>
<br />
You get to the Network Editor from Preferences. Create a new network adapter <b>vmnet2</b> as shown in the screen shot below:<br />
<span style="background-color: white; text-align: left; text-indent: -24px;"><br /></span>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg2tBoHswrV7bX19adZPoQGmM7ZbuncH-Y7ns6X9yo6_1r1wO3-NptF6E6masEHknkaS1KXG28K76Bz-SOLIliwdysWLl3qFVDDgzAUgF-z4Ga3WFdPlE4ofKzLf6ldxv6Mo_kocw/s1600/Screen+Shot+2012-12-15+at+09.51.21.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="285" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg2tBoHswrV7bX19adZPoQGmM7ZbuncH-Y7ns6X9yo6_1r1wO3-NptF6E6masEHknkaS1KXG28K76Bz-SOLIliwdysWLl3qFVDDgzAUgF-z4Ga3WFdPlE4ofKzLf6ldxv6Mo_kocw/s320/Screen+Shot+2012-12-15+at+09.51.21.png" width="320" /></a></div>
<span style="background-color: white; text-align: left; text-indent: -24px;"><br /></span>
Then make sure that for both the Queen and Worker VMWare images you assign <b>vmnet2</b> as your network adapter as illustrated in the screenshot below: <br />
<span style="background-color: white; text-align: left; text-indent: -24px;"><br /></span>
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiLglM7WpwybvVBivO-b9VfDvu-ldx0_ftXoR69iOcfciWEvwge9up8VcPoWQaQ8OUVXOrDzdzPY8prO_l58dhGus8eJXHbaNMnO5OAs8vibXWzuni4YyF4zoovDSNYhysRJ8K_kw/s1600/Screen+Shot+2012-12-15+at+10.20.58.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="245" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiLglM7WpwybvVBivO-b9VfDvu-ldx0_ftXoR69iOcfciWEvwge9up8VcPoWQaQ8OUVXOrDzdzPY8prO_l58dhGus8eJXHbaNMnO5OAs8vibXWzuni4YyF4zoovDSNYhysRJ8K_kw/s320/Screen+Shot+2012-12-15+at+10.20.58.png" width="320" /></a></div>
<span style="background-color: white; text-align: left; text-indent: -24px;"><br /></span>
<br />
<div>
<br /></div>
<div>
That is really the only changes you need to make. Follow the rest of the instructions as outlined in the <i>Getting Started with Aster Express 5.0 </i>to get your Aster nCluster up and running.</div>
<div>
<br /></div>
<div>
If you have 8GB of memory you might decide to allocate 2GB of memory to each VM instead of the 1GB which is the default. Again you can set this in the settings for each VMWare image. I also run the utility <b>Memory Clean </b>(available for free from the App Store). You would be amazed how much a memory hog FireFox and Safari can be. I normally shutdown most other running programs when I am working with Aster Express to give me the best user experience.</div>
<div>
<br /></div>
To run the Aster Management console point your favourite browser to https://192.168.100.100 <i><span lang="EN-US" style="font-family: Calibri; line-height: 115%;">You
may ignore any </span><span lang="EN-US" style="font-family: Calibri; line-height: 115%;">website security certificate</span><span lang="EN-US" style="font-family: Calibri; line-height: 115%;">
warnings and continue to the website.</span></i><br />
<!--[if gte mso 9]><xml>
<o:DocumentProperties>
<o:Revision>0</o:Revision>
<o:TotalTime>0</o:TotalTime>
<o:Pages>1</o:Pages>
<o:Words>12</o:Words>
<o:Characters>74</o:Characters>
<o:Company>Teradata</o:Company>
<o:Lines>1</o:Lines>
<o:Paragraphs>1</o:Paragraphs>
<o:CharactersWithSpaces>85</o:CharactersWithSpaces>
<o:Version>14.0</o:Version>
</o:DocumentProperties>
<o:OfficeDocumentSettings>
<o:RelyOnVML/>
<o:AllowPNG/>
</o:OfficeDocumentSettings>
</xml><![endif]-->
<!--[if gte mso 9]><xml>
<w:WordDocument>
<w:View>Normal</w:View>
<w:Zoom>0</w:Zoom>
<w:TrackMoves/>
<w:TrackFormatting/>
<w:PunctuationKerning/>
<w:ValidateAgainstSchemas/>
<w:SaveIfXMLInvalid>false</w:SaveIfXMLInvalid>
<w:IgnoreMixedContent>false</w:IgnoreMixedContent>
<w:AlwaysShowPlaceholderText>false</w:AlwaysShowPlaceholderText>
<w:DoNotPromoteQF/>
<w:LidThemeOther>EN-US</w:LidThemeOther>
<w:LidThemeAsian>JA</w:LidThemeAsian>
<w:LidThemeComplexScript>X-NONE</w:LidThemeComplexScript>
<w:Compatibility>
<w:BreakWrappedTables/>
<w:SnapToGridInCell/>
<w:WrapTextWithPunct/>
<w:UseAsianBreakRules/>
<w:DontGrowAutofit/>
<w:SplitPgBreakAndParaMark/>
<w:EnableOpenTypeKerning/>
<w:DontFlipMirrorIndents/>
<w:OverrideTableStyleHps/>
</w:Compatibility>
<m:mathPr>
<m:mathFont m:val="Cambria Math"/>
<m:brkBin m:val="before"/>
<m:brkBinSub m:val="--"/>
<m:smallFrac m:val="off"/>
<m:dispDef/>
<m:lMargin m:val="0"/>
<m:rMargin m:val="0"/>
<m:defJc m:val="centerGroup"/>
<m:wrapIndent m:val="1440"/>
<m:intLim m:val="subSup"/>
<m:naryLim m:val="undOvr"/>
</m:mathPr></w:WordDocument>
</xml><![endif]--><!--[if gte mso 9]><xml>
<w:LatentStyles DefLockedState="false" DefUnhideWhenUsed="true"
DefSemiHidden="true" DefQFormat="false" DefPriority="99"
LatentStyleCount="276">
<w:LsdException Locked="false" Priority="0" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Normal"/>
<w:LsdException Locked="false" Priority="9" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="heading 1"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 2"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 3"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 4"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 5"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 6"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 7"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 8"/>
<w:LsdException Locked="false" Priority="9" QFormat="true" Name="heading 9"/>
<w:LsdException Locked="false" Priority="39" Name="toc 1"/>
<w:LsdException Locked="false" Priority="39" Name="toc 2"/>
<w:LsdException Locked="false" Priority="39" Name="toc 3"/>
<w:LsdException Locked="false" Priority="39" Name="toc 4"/>
<w:LsdException Locked="false" Priority="39" Name="toc 5"/>
<w:LsdException Locked="false" Priority="39" Name="toc 6"/>
<w:LsdException Locked="false" Priority="39" Name="toc 7"/>
<w:LsdException Locked="false" Priority="39" Name="toc 8"/>
<w:LsdException Locked="false" Priority="39" Name="toc 9"/>
<w:LsdException Locked="false" Priority="35" QFormat="true" Name="caption"/>
<w:LsdException Locked="false" Priority="10" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Title"/>
<w:LsdException Locked="false" Priority="1" Name="Default Paragraph Font"/>
<w:LsdException Locked="false" Priority="11" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtitle"/>
<w:LsdException Locked="false" Priority="22" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Strong"/>
<w:LsdException Locked="false" Priority="20" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Emphasis"/>
<w:LsdException Locked="false" Priority="59" SemiHidden="false"
UnhideWhenUsed="false" Name="Table Grid"/>
<w:LsdException Locked="false" UnhideWhenUsed="false" Name="Placeholder Text"/>
<w:LsdException Locked="false" Priority="1" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="No Spacing"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 1"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 1"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 1"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 1"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 1"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 1"/>
<w:LsdException Locked="false" UnhideWhenUsed="false" Name="Revision"/>
<w:LsdException Locked="false" Priority="34" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="List Paragraph"/>
<w:LsdException Locked="false" Priority="29" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Quote"/>
<w:LsdException Locked="false" Priority="30" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Quote"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 1"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 1"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 1"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 1"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 1"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 1"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 1"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 1"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 2"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 2"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 2"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 2"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 2"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 2"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 2"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 2"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 2"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 2"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 2"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 2"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 2"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 2"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 3"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 3"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 3"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 3"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 3"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 3"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 3"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 3"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 3"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 3"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 3"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 3"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 3"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 3"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 4"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 4"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 4"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 4"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 4"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 4"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 4"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 4"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 4"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 4"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 4"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 4"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 4"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 4"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 5"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 5"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 5"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 5"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 5"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 5"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 5"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 5"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 5"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 5"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 5"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 5"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 5"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 5"/>
<w:LsdException Locked="false" Priority="60" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Shading Accent 6"/>
<w:LsdException Locked="false" Priority="61" SemiHidden="false"
UnhideWhenUsed="false" Name="Light List Accent 6"/>
<w:LsdException Locked="false" Priority="62" SemiHidden="false"
UnhideWhenUsed="false" Name="Light Grid Accent 6"/>
<w:LsdException Locked="false" Priority="63" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 1 Accent 6"/>
<w:LsdException Locked="false" Priority="64" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Shading 2 Accent 6"/>
<w:LsdException Locked="false" Priority="65" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 1 Accent 6"/>
<w:LsdException Locked="false" Priority="66" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium List 2 Accent 6"/>
<w:LsdException Locked="false" Priority="67" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 1 Accent 6"/>
<w:LsdException Locked="false" Priority="68" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 2 Accent 6"/>
<w:LsdException Locked="false" Priority="69" SemiHidden="false"
UnhideWhenUsed="false" Name="Medium Grid 3 Accent 6"/>
<w:LsdException Locked="false" Priority="70" SemiHidden="false"
UnhideWhenUsed="false" Name="Dark List Accent 6"/>
<w:LsdException Locked="false" Priority="71" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Shading Accent 6"/>
<w:LsdException Locked="false" Priority="72" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful List Accent 6"/>
<w:LsdException Locked="false" Priority="73" SemiHidden="false"
UnhideWhenUsed="false" Name="Colorful Grid Accent 6"/>
<w:LsdException Locked="false" Priority="19" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtle Emphasis"/>
<w:LsdException Locked="false" Priority="21" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Emphasis"/>
<w:LsdException Locked="false" Priority="31" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Subtle Reference"/>
<w:LsdException Locked="false" Priority="32" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Intense Reference"/>
<w:LsdException Locked="false" Priority="33" SemiHidden="false"
UnhideWhenUsed="false" QFormat="true" Name="Book Title"/>
<w:LsdException Locked="false" Priority="37" Name="Bibliography"/>
<w:LsdException Locked="false" Priority="39" QFormat="true" Name="TOC Heading"/>
</w:LatentStyles>
</xml><![endif]-->
<!--[if gte mso 10]>
<style>
/* Style Definitions */
table.MsoNormalTable
{mso-style-name:"Table Normal";
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:yes;
mso-style-priority:99;
mso-style-parent:"";
mso-padding-alt:0cm 5.4pt 0cm 5.4pt;
mso-para-margin:0cm;
mso-para-margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:10.0pt;
font-family:Calibri;
mso-ansi-language:EN-US;}
</style>
<![endif]-->
<!--StartFragment--><!--EndFragment--><br />
<div>
<br /></div>
<div>
You will also find mac versions of <i>act</i> and <i>ncluster_loader</i> in <i>/home/beehive/clients_all/mac</i>. I just copy them to my host. In fact, Once I start up the VMWare images, I do most everything natively from the Mac.</div>
<div>
<br /></div>
<div>
In future posts I plan to cover the following topics:</div>
<div>
<ul>
<li>How to scale your Aster Express nCluster and make it more reliable</li>
<li>Demo: From Raw Web log to Business Insight</li>
<li>Demo: Finding the sentiment in Twitter messages</li>
</ul>
<div>
If there are topics you would like me to cover in the future, then just let me know.</div>
</div>
<div>
<br /></div>
<div>
<br /></div>
Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com4206 Marylebone Rd, Marylebone, City of Westminster, London NW1, UK51.5216444 -0.161893551.5191744 -0.166829 51.5241144 -0.156958tag:blogger.com,1999:blog-36349144.post-23738899912825197992012-10-24T23:50:00.000+01:002012-10-24T23:50:16.158+01:00My perspective on the Teradata Aster Big Analytics Appliance<table cellpadding="0" cellspacing="0" class="tr-caption-container" style="float: right; text-align: right;"><tbody>
<tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgu1Lb6aJ3L0vZoDDQTLrd9GjXeRi77kBNNjaa59gmnH0WLxkwbMobGhyz7xLsiXI83HCLNasKsGiV8hOV9r81dG6NidYZOsnDQWDSLruL6iHHMMhSYmP7V0RDiIB-UZck60fCEQw/s1600/Appliance3.png" imageanchor="1" style="clear: right; margin-bottom: 1em; margin-left: auto; margin-right: auto;"><img alt="" class="" height="400" id="blogsy-1350468029597.6736" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgu1Lb6aJ3L0vZoDDQTLrd9GjXeRi77kBNNjaa59gmnH0WLxkwbMobGhyz7xLsiXI83HCLNasKsGiV8hOV9r81dG6NidYZOsnDQWDSLruL6iHHMMhSYmP7V0RDiIB-UZck60fCEQw/s400/Appliance3.png" width="250" /></a></td></tr>
<tr><td class="tr-caption" style="text-align: center;"><b>Aster Big Analytics Appliance 3H</b></td><td class="tr-caption" style="text-align: center;"><br /></td></tr>
</tbody></table>
<br />
By now, no doubt you have heard the announcement of our new Teradata Aster Big Analytics Appliance. In the interests of full disclosure, I work for Teradata within the Aster CoE in Europe. Prior to joining Teradata, I was responsible for a large complex Aster environment which was built on commodity servers in excess of 30 TB of usable data with a 24 x 7 style operational environment. So my perspective in this post is from that standpoint and also recalling the time when we went under a hardware refresh and software upgrade.<br />
<br />
OK, First of all you procure 30 servers and at least two network switches (for redundancy). When you receive them, it up to your data centre team to rack them and cable them up. Next, check the firmware on each system is the same, surprise, surprise they aren't, so a round of upgrades later, then you configure the raid controllers. In this case we went for Raid 0 which maximises space, more on that choice later...<br />
<br />
Then it is over to the network team, to configure the switches and the VLAN we are going to use. We then put on a basic Linux image on the servers so we can carry out some burn in tests, to make sure all the servers have a similar performance profile. Useful tests, as we found two servers whose raid controllers were not configured correctly. It was the result of human error, I guess manually doing 30 servers can get boring. This burns through a week, before we can install Aster, configure the cluster and bring all the nodes online to start the data migration process. Agreed, this is a one off cost, but in this environment, we are responsible for all hardware issues, network issues, Linux issues, with the Vendor just supporting Aster. Many customers never count that cost or possible outages that might be avoided because of these one off configurations.<br />
<br />
We had some basic system management as these are commodity servers but nothing as sophisticated as Teradata Server Management and the Teradata Vital Infrastructure. I like that with the Server management software it allows me to manage 3 clusters within the Rack logically (e.g. Test, Production, Backup). I also like the proactive monitoring, as it is likely they will identify issues prior to them becoming an outage for us, or an issue found with one customer can be checked against all customers. If you build and manage your own environment, you don't get that benefit.<br />
<br />
Your next consideration should be when looking at an appliance, is it leading edge and how much thought has gone into the configuration? The Appliance 3H is a major step forward from Appliance 2. From a CPU perspective, it has the very latest processors from Intel, dual 8 core Sandy Bridge @ 2.6GHz. Memory has increased to 256GB. Connectivity between nodes is now provided by Infiniband at 40Gb/s. Disk drives are the newer 2.5 size, enabling more capacity per node. Worker nodes using 900GB, while backup and the Hadoop nodes leveraging larger 3TB drives. RAID 5 for Aster and RAID 6 for the backup and Hadoop nodes. Also with the larger cabinet size, enables better data centre utilisation with the higher density that is possible.<br />
<br />
I also like the idea of providing integrated Backup nodes as well, previously Aster just had the parallel backup software only, you had to procure your own hardware and manage it. We also know that all of these components have been tested together, so I am benefiting from their extensive testing, rather than building and testing reference configurations myself.<br />
<br />
What this tells me, is that Teradata, can brings advances in hardware quickly to the marketplace. Infiniband will make make an important difference. For example, for very large dimension tables, that I have decided against replicating, joins will run much faster. Also I expect positive impact on Backups. In my previous environment, it took us about 8 hours for a full backup of 30 TB or so. Certainly the parallel nature of their backup software could soak-up all the bandwidth on a 10GB connection, so we had to throttle it back. On the RAID choices, I absolutely concur with the RAID 5 choice. If I was building my own 30 node cluster again I wouldn't have it any other way. While the replication capabilities in Aster protects me against at least any single node failure, a disk failure, will bring that node out of the cluster, until the disk is replaced and the node is rebuilt and brought back online. When you have 30+ servers each with 8 drives (240+ disk drives) the most common failure will be the disk drive. With RAID 5, you can replace the drive, without any impact on the cluster at all, and you still have the replication capabilities to protect yourself from multiple failures.<br />
<br />
I also like the option of being able to have an Hadoop cluster tightly integrated as part of my configuration. For example if I have to store a lot of 'grey data' e.g. log/audit files etc for compliance reasons, I can leverage a lower cost of storage and still do batch transformations and analysis as required. Bring a working set of data (last year for example) for deeper analytics. With the transparent capabilities of SQL-H, I can extend those analytics into my Hadoop environment as required.<br />
<br />
Of course purchasing an appliance, is a more expensive route than procuring it, building and configuring it all yourself. However, most enterprise are not hobbyists, and building this sort of infrastructure, is not their core competence nor is is bringing value to their business. They should be focused on the Time to Value and with the Teradata Aster Big Analytics appliance the time to value will be quick, as everything, is prebuilt, configured, tested and ready to go, to accept data and start performing analytics on it. As I talk to customers across Europe this message is being well received when you talk through the details.<br />
<br />
I'll leave you with this thought, one aspect of big data that I don't hear enough of is Value. To me, the dimension of Volume, Variety, Velocity and Complexity are not very interesting if you are not providing value by means of actionable insights. I believe every enterprise customer needs a discovery platform capable of executing the analytics that can provide them an important competitive edge over their competition. This platform should have the capability to handle structured as well as multi-structured data. It should provide a choice of analytics, whether they be SQL based, MapReduce or statistical functions. It should provide a host of prebuilt functions to enable rapid progress. It should be a platform that can appeal to power users in the business, by having a SQL interface and that will work with their existing visualisation tools to our most sophisticated data scientists, by providing them a rich environment to develop their own custom functions as necessary, while enabling them to benefit both from the power of SQL and Map Reduce to build out these new capabilities. In summary that is why I am so excited to be talking with customers and prospects about Teradata Aster Big Analytics Appliance.<br />
<br />
<br />
<br />
<br />
<br />
<br />Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com5206 Marylebone Rd, Marylebone, City of Westminster, London NW1, UK51.5216444 -0.161893551.5191744 -0.166829 51.5241144 -0.156958tag:blogger.com,1999:blog-36349144.post-35830692970380223072012-10-11T10:49:00.002+01:002012-10-22T00:44:59.002+01:00Aster integration into the Teradata Analytical ecosystem continues at pace…<span style="font-family: inherit;">Not long after Teradata acquired Aster in April last year we outlined a roadmap as to how Aster would integrate into the Teradata Analytical ecosystem.</span><br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg2u_Hs5d2gaQ50uQO4kn3kbjPz3Vurj_OyTZsHi6DPO6SC1vCAlQBySWGi7vbStPlbWv8486LLffCEGlrH4iFJQhN4F4H1vfBRi0vRWGgmdOb56vk_zDdEfIUMqLeHZqDArBuqKQ/s1600/Slide1.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img alt="" class="" height="300" id="blogsy-1350360721889.87" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg2u_Hs5d2gaQ50uQO4kn3kbjPz3Vurj_OyTZsHi6DPO6SC1vCAlQBySWGi7vbStPlbWv8486LLffCEGlrH4iFJQhN4F4H1vfBRi0vRWGgmdOb56vk_zDdEfIUMqLeHZqDArBuqKQ/s400/Slide1.jpg" width="400" /></a></div>
<div class="separator" style="clear: both; text-align: left;">
<span lang="EN-US" style="font-family: inherit;"><br /></span></div>
<div class="separator" style="clear: both; text-align: left;">
<span lang="EN-US" style="font-family: inherit;"></span></div>
<h2 style="text-align: -webkit-auto;">
<span lang="EN-US" style="font-family: inherit;"><a href="http://www.asterdata.com/product/ecosystem/teradata.php" style="font-family: inherit;">Aster-Teradata Adapter</a></span></h2>
<br />
<div class="separator" style="clear: both; text-align: left;">
<span lang="EN-US" style="font-family: inherit;">Clearly, the first priority was to delivera high speed interconnect between Aster And Teradata. </span><span style="font-family: inherit;">The </span><a href="http://www.asterdata.com/product/ecosystem/teradata.php" style="font-family: inherit;">Aster-Teradata adapter</a><span style="font-family: inherit;"> is based on the Teradata Parallel Transporter API and provides ahigh-speed link to transfer data between the two platforms. It allows parallel data transfers between Aster and Teradata, with each Aster Worker connecting toa Teradata AMP. This connector is part of the Aster SQL-MR library, with all data transfers initiated through AsterSQL.</span></div>
<span lang="EN-US"><span style="font-family: inherit;">The Aster-Teradata adapter offers fast and efficient data access. Users can build views in the Aster Database on tables stored in Teradata. Aster Database users can access and perform joins on Teradata-stored data as if it were stored in the Aster Database. Data scientists can run Aster’s native analytic modules,such as nPath pattern matching, to explore data in the Teradata Integrated DataWarehouse. Users now have the capability to Investigate & Discover in Teradata Aster, then Integrate & Operationalize in the Data Warehouse.<o:p></o:p></span></span><br />
<br />
<span lang="EN-US"><span style="font-family: inherit;"><span style="font-family: inherit;">This example below shows the load_from_teradata connector being called from within an Aster SQL query:</span></span></span><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;">SELECT userid, age, sessionid,pageid</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;">FROM nPath(</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> ON (</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> select * fromclicks, </span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> load_from_teradata( </span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> on mr_driver tdpid(‘EDW')</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> credentials ('tduser’)</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> query(‘SELECT userid, age, gender, income FROM td_user_tbl;')</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> ) T</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> where clicks.userid =T.userid )</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> PARTITION BY userid, sessionid </span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> RESULT ( FIRST(age of A) as age, … )<o:p></o:p></span></em></strong><br />
<br />
<span style="font-family: inherit;">This example shows the load_to_teradata component, with analytic processing on Aster withresults being sent to a Teradata target table:</span><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;">SELECT *</span></em></strong><br />
<br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;">FROM load_to_teradata(</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> ON ( aster_target_customers )</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> tdpid (‘dbc’)</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> username('tduser’)</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> password(‘tdpassword')</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;"> TARGET_TABLE(‘td_target_customer_table’)</span></em></strong><strong><em><span style="font-family: Calibri; mso-ansi-language: EN-GB;"><o:p></o:p></span></em></strong><br />
<br />
<strong><em><span lang="EN-US" style="font-family: Calibri;">);</span></em></strong><br />
<br />
<h2>
<span lang="EN-US" style="font-family: Calibri;"><a href="http://developer.teradata.com/viewpoint/articles/teradata-viewpoint-14-01-release">Viewpoint Integration</a></span></h2>
<span lang="EN-US"><span style="font-family: inherit;">We have just announced Aster integration with Teradata Viewpoint, with release of 14.01 of Viewpoint and Aster 5.0. </span></span><span style="font-family: inherit;">Viewpoint's single operational view (SOV) monitoring has been extended to include support for Teradata Aster. Teradata wanted to leverage as many of the existing portlets as possible for easier navigation, familiarity, and support for theViewpoint SOV strategy. So the following existing portlets were extended to include support for Aster:</span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">System Health<o:p></o:p></span></span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">Query Monitor<o:p></o:p></span></span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">Capacity Heatmap<o:p></o:p></span></span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">Metrics Graph<o:p></o:p></span></span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">Metrics Analysis<o:p></o:p></span></span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">Space Usage</span></span><br />
<br />
<span lang="EN-US" style="font-family: inherit; text-indent: -18pt;">• </span><span lang="EN-US" style="font-family: inherit; text-indent: -18pt;">Admin - Teradata Systems</span><br />
<span style="font-family: inherit;"><span lang="EN-US"> </span><!--[endif]--><span lang="EN-US"> </span></span><br />
<br />
<span lang="EN-US"><span style="font-family: inherit;">However not all the needs of Teradata Aster's differing architecture made sense to put into an existing portlet. Therefore there are two new Aster specific portlets in this release.</span></span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">Aster Completed Processes<o:p></o:p></span></span><br />
<br />
<!--[if !supportLists]--><span style="font-family: inherit;"><span lang="EN-US">• </span><!--[endif]--><span lang="EN-US">Aster Node Monitor</span></span><br />
<br />
<span lang="EN-US"><span style="font-family: inherit;">Some screenshots:</span><span style="font-family: Calibri;"><o:p></o:p></span></span><br />
<br />
<div class="MsoNormal">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjwHPewiQVLoDY7CoC_HGlVn7jvhHmYtwPpcBb2gJ-E4GPSfTCn6WFgh4Tp9NCwe6_RZ2wYDapByq_H7sludErE4ekLKYqE3muhluCFIykCtZA_dfSts0txdnvRz15GcA_7p6fhzQ/s1600/asterhealth.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img alt="" class="" height="93" id="blogsy-1350360721855.6516" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjwHPewiQVLoDY7CoC_HGlVn7jvhHmYtwPpcBb2gJ-E4GPSfTCn6WFgh4Tp9NCwe6_RZ2wYDapByq_H7sludErE4ekLKYqE3muhluCFIykCtZA_dfSts0txdnvRz15GcA_7p6fhzQ/s400/asterhealth.png" width="400" /></a></div>
</div>
<div class="MsoNormal">
<span lang="EN-US" style="font-family: Calibri;"></span></div>
<div class="MsoNormal">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj56DEVXvP563u5918lg7clZPG5pOhr4w1iepzmzaV2p-sR5rMguTAQUkJxWHCrWc7t7xpL2p8_SQf_-4lUP4i9d1XbPwyMkkWmo3UH7AtykoBM5Lf2M0RnDeLThSS448DimV34ng/s1600/asterhealth2.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img alt="" class="" height="276" id="blogsy-1350360721892.8623" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj56DEVXvP563u5918lg7clZPG5pOhr4w1iepzmzaV2p-sR5rMguTAQUkJxWHCrWc7t7xpL2p8_SQf_-4lUP4i9d1XbPwyMkkWmo3UH7AtykoBM5Lf2M0RnDeLThSS448DimV34ng/s400/asterhealth2.png" width="400" /></a><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj56DEVXvP563u5918lg7clZPG5pOhr4w1iepzmzaV2p-sR5rMguTAQUkJxWHCrWc7t7xpL2p8_SQf_-4lUP4i9d1XbPwyMkkWmo3UH7AtykoBM5Lf2M0RnDeLThSS448DimV34ng/s1600/asterhealth2.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"></a><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj56DEVXvP563u5918lg7clZPG5pOhr4w1iepzmzaV2p-sR5rMguTAQUkJxWHCrWc7t7xpL2p8_SQf_-4lUP4i9d1XbPwyMkkWmo3UH7AtykoBM5Lf2M0RnDeLThSS448DimV34ng/s1600/asterhealth2.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"></a></div>
<span lang="EN-US" style="font-family: Calibri;"><br />
</span><br />
<br /></div>
<div class="MsoNormal">
<span lang="EN-US" style="font-family: Calibri;"></span></div>
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiaPBTJncz5U0K-O85_FGG7iLKnxeVsHlRIGimqPmxAR2rde9p81kp_tLnSh18DutHZUKC9HXVqqgAnFKhzY4uU2SyYfAVLyCLHkmW9ZGt7H5_Qo_tp-MuZkelCchtUWp4s0FVtuA/s1600/aqmon2.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><a href="http://www.blogger.com/blogger.g?blogID=36349144" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"></a><img alt="" class="alignleft" height="121" id="blogsy-1350360721852.6423" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiaPBTJncz5U0K-O85_FGG7iLKnxeVsHlRIGimqPmxAR2rde9p81kp_tLnSh18DutHZUKC9HXVqqgAnFKhzY4uU2SyYfAVLyCLHkmW9ZGt7H5_Qo_tp-MuZkelCchtUWp4s0FVtuA/s400/aqmon2.png" width="400" /><br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi4ZXGOe0UsuNmTBuOs6HsSrbo4qUU-LPukjo6JQ3o7zIxbEUyxVmGtX90PJXMAWLmnv2RkJP-nk3LND3lRnL0eXKim8e_9HddF7WVPMFB_e9cs2Sv6TfDRhmfwCS2jX3HmKZF-nQ/s1600/anodemon.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img alt="" class="" height="156" id="blogsy-1350360721813.5466" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi4ZXGOe0UsuNmTBuOs6HsSrbo4qUU-LPukjo6JQ3o7zIxbEUyxVmGtX90PJXMAWLmnv2RkJP-nk3LND3lRnL0eXKim8e_9HddF7WVPMFB_e9cs2Sv6TfDRhmfwCS2jX3HmKZF-nQ/s400/anodemon.png" width="400" /></a></div>
<div class="MsoNormal">
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgJt6MeiexOXvta5U9Hw25_bkSki6LBQGQy2WdjuNFQ7i5kvGtd6PuZlLxpzh4Mrl4CS6-x0qooFePXwLwaOcB07qqIKbeBHRpnR9NSgN3tkMsHX1FM8D5dROzn3RigAfkEcpzqtg/s1600/hrdwstats.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="305" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgJt6MeiexOXvta5U9Hw25_bkSki6LBQGQy2WdjuNFQ7i5kvGtd6PuZlLxpzh4Mrl4CS6-x0qooFePXwLwaOcB07qqIKbeBHRpnR9NSgN3tkMsHX1FM8D5dROzn3RigAfkEcpzqtg/s400/hrdwstats.png" width="400" /></a></div>
<br /></div>
<div class="MsoNormal">
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span><br />
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;"><br /></span></span></span></span>
<span lang="EN-US"><span style="font-family: inherit;"><span lang="EN-US"><span style="font-family: inherit;">Check out the complete article on Viewpoint 14.01 release at the Teradata Developer Exchange <a href="http://developer.teradata.com/viewpoint/articles/teradata-viewpoint-14-01-release">here</a>.</span></span></span></span></div>
<span lang="EN-US"><span style="font-family: inherit;">Stay tuned for some very exciting news coming next week...</span></span> <br />
<br />
<br />
<br />Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com3Marylebone, City of Westminster, London NW1 6LY, UK51.5218477 -0.16175651.5193777 -0.16669150000000002 51.524317700000005 -0.1568205tag:blogger.com,1999:blog-36349144.post-63918918006454467002012-10-05T08:48:00.002+01:002012-10-15T17:04:32.880+01:00Don't be left in the dark... Exciting Teradata Aster Announcement coming soon<div class="separator" style="clear: both; text-align: center;">
<a href="webkit-fake-url://65A0FED5-2EC2-4CC3-9ED1-D873BD45CD57/image.tiff" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"></a></div>
<br />
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt;">
<br /></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt;">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhL4VID1f3iYDiU_4oVldnBVG6CfDaVQ6FafTpFL1rEWRAMW8xvRDG0FSINStMHvcl1iy2gfgQdWrRHICxl5qB16YGSp1L4Z6QK2jWTRZduu_m6LPhAJtj2X7KgFg_J1YWmzgpIGw/s1600/pre_lunch_img.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="187" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhL4VID1f3iYDiU_4oVldnBVG6CfDaVQ6FafTpFL1rEWRAMW8xvRDG0FSINStMHvcl1iy2gfgQdWrRHICxl5qB16YGSp1L4Z6QK2jWTRZduu_m6LPhAJtj2X7KgFg_J1YWmzgpIGw/s400/pre_lunch_img.jpg" width="400" /></a></div>
<span style="font-family: Calibri, sans-serif;"><span style="font-size: 11pt;">We’re gearing up for a big <span style="color: orange;">Teradata Aster</span> announcement. Mark your calendars to get the scoop on Oct 17th. We will be hosting a live Webinar to announce it. <a href="http://goo.gl/7JvI1" target="_blank">Register here for it</a>. </span></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt;">
<span style="font-family: Calibri, sans-serif;"><span style="font-size: 15px;"><br /></span></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt;">
<span style="font-family: Calibri, sans-serif;"><span style="font-size: 15px;">Believe me, it is going to be amazing...</span></span></div>
<div class="MsoNormal" style="margin: 0in 0in 0.0001pt;">
<br /></div>
Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0Sherfield on Loddon, Hampshire, UK51.31795 -1.024022951.298102 -1.0635049 51.337798000000006 -0.9845409tag:blogger.com,1999:blog-36349144.post-72854370619224911912012-10-03T00:04:00.000+01:002012-10-03T00:04:53.858+01:00The Big Data Analytics LandscapeAs a technologist and evangelist working in the big data marketplace it is certainly exciting. I am excited by the new products we are bringing to market and how this new functionality really helps to bridge the gap for Enterprises adoption. It is also surreal, in terms of the number of blog posts, tweets on Big Data and there seems to be a new big data conference cropping up on a weekly basis across Europe :-)<br />
<br />
It is interesting to monitor other vendors in the marketplace and how they position their offerings. There is certainly a lot of clever marketing going on (that I believe in time will show a lack of substance) and some innovation too, . You know who you are.... But jump aboard the bandwagon. Just because you might have Hadoop and your database + Analytics within the same rack that doesn't mean they are integrated.<br />
<br />
It is also interesting the fervor that people bring when discussing open source products. Those people who know me, know that I am a long time UNIX guru over 20 years from the early BSD distributions to working with UNIX on mainframes, to even getting minix to work on PC's before Linux came along. Fun times, but I was young free and single and enjoyed the technical challenge. I was also working in a research department in a university. However the argument that Hadoop is free and easy to implement and will one day replace data warehousing, doesn't ring true for me. Certainly it is true is has a place, and does provide value, but it doesn't come at no cost. Certainly Hortonworks and Cloudera provide distributions that are reducing the installation/configuration and management effort, but you have multiple distributions, starting to go in different directions? MapR for example? <br />
<br />
How many enterprises really want to get that involved in running and maintaining this infrastructure. Surely they should be focused on identify new insights that provides business benefits or gives greater competitive advantage. IT has an important role to play, but it will be the business users ultimately that need to leverage the platform to gain these insights.<br />
<br />
It is no use getting insights, if you don't take action on them either.<br />
<br />
Insight gained from big data analytics should be fed into existing EDW
(if they exist) so they can enhance what you already have and the EDW
provides you with a better means of operationalizing the results. <br />
<br />
I say to those people who think Hive is a replacement for SQL, not
yet it ain't, it doesn't provide the completeness or performance that a
pure SQL engine can provide. You don't replace 30+ years of R&D that
quickly...<br />
<br />
To the NoSQL folks, this debate is taking
on religious fervour at times, It has a role, but I don't see it
replacing the relational database overnight either.<br />
<br />
In a previous role I managed a complex DB Environment that included a Big Data platform for a company that operated in the online gaming marketplace in a very much 24 X 7 environment, with limited downtime. It was the bleeding edge at times, growing very fast. If we had Teradata Aster 5.0 then, my life would have been so much easier. Se had an earlier release but we learned a lot. We proved the value of SQL combined with the Map Reduce programming paradigm. We saw the ease of scaling and reliability, We delivered important insights into various types of fraud, and took action on them, which yielded positive kudos for the company and increased player trust, which is very important in an online marketplace. We also were able to leverage the platform for an novel ODS requirement and had both executing simultaneously along with various ad-hoc queries. I was also lucky then and since to meet real visionaries, like Mayank and Tasso which gives you confidence in the approach and the future direction <br />
<br />
When you think of big data analytics, it just not just about multi structure data or new data sources. Using SQL/MR for example may be the most performant way to yield new insights from existing relational data. Also consider what 'grey data' already exists within your organisations, it maybe easier to tap into that first, before sourcing new data feeds. The potential business value should drive that decision though.<br />
<br />
Do not under estimate the important of having a discovery platform as you tackle these new Big Data Challenges. Yes, you will probably need new people or even better, train existing analysts to take on these new skills and grow your own data scientists. The ease of this approach, will be in how feature rich your discovery platform is, How many built in and useful analytical functions are provided to get you started, before you may have to develop specific ones of your own.<br />
<br />
I suppose, some would say I am rambling with these comments and not expressing them very elegantly, but help is at hand :-). We recently put together a short webinar, I think it is about 20 minutes duration. <br />
<br />
<b>The Big Data Analytics Landscape</b>: Trends, Innovations and New Business Value, featuring Gartner Research Vice President Merv Adrian and Teradata Aster Co-President Tasso Argyros. In the video, Merv and Tasso, answer these questions and more, including how organizations can find the right solution - to make smarter decisions, take calculated risks, and gain deeper insights than their industry peers.<br />
<br />
<ul>
<li>How do you cost-effectively harness and analyze new big data sources?</li>
<li>How does the role of a data scientist differ from other analytic professionals? </li>
<li>What skills does the data scientist need?</li>
<li>What are the differences between Hadoop, MapReduce, and a Data Discovery Platform?</li>
<li>How are these new sources of big data and analytic techniques and technology helping organizations find new truths and business opportunities?</li>
</ul>
I suggest if you have the time to spare... watch the <a href="http://www.asterdata.com/gartner-big-data-analytics-landscape/" target="_blank">video</a><br />
<br />
What do you think? <br />
<br />
<i>For me it is all about the analytics and the new insights that can be gained and acted upon </i><br />
<br />Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0Sherfield on Loddon, Hampshire RG27 0SH, UK51.3018032 -1.046321551.2993212 -1.0512569999999999 51.3042852 -1.041386tag:blogger.com,1999:blog-36349144.post-67165532943506688112012-06-09T21:17:00.001+01:002012-06-09T22:04:49.565+01:00First Steps in Exploring Social Media Analytics<div style="font-family: inherit;">
As I talk with customers and colleagues the topic of social media analytics is often featured. Some customers have already got a strategy defined and are executing to a plan while others are at a more nascent stage but believe in the potential to have a direct and almost immediate connection to their customers.</div>
<div style="font-family: inherit;">
<br /></div>
<div style="font-family: inherit;">
I'll admit that I am somewhat of a social media novice so it will be a learning experience for me too. I am intrigued by the depth of analytics that may be possible. Only this month did I setup my profile on Facebook and I'm 47! I have been using Twitter more regularly of late, since our Teradata Universe conference and I probably look at it 3 or 4 times a day, depending on what's on my schedule for the day. I am finding some interesting, funny and informative updates each day, as I slowly expand the number of people I follow. It is really a mixture of friends and work related contacts at the moment. I have been a member of LinkedIn for a number of years and find it a useful resource from a professional perspective. I am within the first 1% of members who subscribed to this site (I received an email to that effect, that I was within the first 1 million sign ups when the site hit 100 million). Finally I am keen on blogging more frequently when I have something interesting to share (i.e. this! :-) ) I had stopped blogging for about 5 years at one point. I have also started with Flickr and YouTube as well. I'll be my own guinea pig in some ways as I explore and experiment on possible useful analytics in these social media channels. </div>
<div style="font-family: inherit;">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="font-family: inherit; margin-left: 0cm;">
However when most people think of Social Media and associated analytics, Facebook and Twitter are often mentioned first.
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073711037 9 0 511 0;}
@font-face
{font-family:Wingdings;
panose-1:2 0 5 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:Wingdings;
panose-1:2 0 5 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:"MS Mincho";
mso-font-alt:"MS 明朝";
mso-font-charset:128;
mso-generic-font-family:modern;
mso-font-pitch:fixed;
mso-font-signature:-536870145 1791491579 18 0 131231 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0cm;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:10.0pt;
mso-ansi-font-size:10.0pt;
mso-bidi-font-size:10.0pt;
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:EN-GB;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;
mso-header-margin:36.0pt;
mso-footer-margin:36.0pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:255790767;
mso-list-type:hybrid;
mso-list-template-ids:-231456940 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:18.0pt;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:54.0pt;
text-indent:-18.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:90.0pt;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso
</style>
These social media systems do provide an API that can be used to readily access data,
and these split into two broad categories that reflect the social media’s
attitude to customer data. </div>
<div class="MsoListParagraphCxSpMiddle" style="font-family: inherit; margin-left: 0cm;">
<br /></div>
<div class="MsoListParagraphCxSpMiddle" style="font-family: inherit; margin-left: 0cm;">
The
first approach is the open approach adopted by Twitter. Users on Twitter are warned that their posts
are visible to anyone (who can find them). The
second approach is that adopted by Facebook. There is an extensive privacy
model, and data needs to be accessed using authorizations (from likes and
games).</div>
<div class="MsoListParagraphCxSpLast" style="font-family: inherit; margin-left: 0cm;">
<br /></div>
<div class="MsoNormal" style="font-family: inherit;">
<b><span lang="EN-US">Twitter</span></b></div>
<ul style="font-family: inherit;">
<li><span lang="EN-US">Data
is free b</span><span lang="EN-US">ut
there is a lot of it</span></li>
<li><span lang="EN-US">Identifying
relevant stuff isn’t easy</span></li>
<li><span lang="EN-US">History
isn’t usually available</span></li>
</ul>
<div class="MsoListParagraphCxSpLast" style="font-family: inherit; margin-left: 18pt;">
<br /></div>
<div class="MsoNormal" style="font-family: inherit;">
<b><span lang="EN-US">Facebook</span></b></div>
<ul style="font-family: inherit;">
<li><span lang="EN-US">Public
data is free through search</span></li>
<li><span lang="EN-US">Basic
data available through application</span></li>
<li><span lang="EN-US">More
sophisticated data available with permissions (using Oauth 2.0)</span></li>
</ul>
<div class="MsoListParagraphCxSpLast" style="font-family: inherit; margin-left: 18pt; text-indent: -18pt;">
<span lang="EN-US"> </span>
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1107305727 0 0 415 0;}
@font-face
{font-family:"MS Mincho";
mso-font-alt:"MS 明朝";
mso-font-charset:128;
mso-generic-font-family:modern;
mso-font-pitch:fixed;
mso-font-signature:-536870145 1791491579 18 0 131231 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0cm;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:10.0pt;
mso-ansi-font-size:10.0pt;
mso-bidi-font-size:10.0pt;
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:EN-GB;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;
mso-header-margin:36.0pt;
mso-footer-margin:36.0pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
</div>
<div class="MsoNormal" style="font-family: inherit;">
Focusing on Facebook and Twitter you see two very
different levels of information. Twitter
provides only basic, row level data. Facebook provides much more complex, relational
data. We'll explore these in more detail in future posts.</div>
<div class="MsoNormal" style="font-family: inherit;">
<br /></div>
<div class="MsoNormal" style="font-family: inherit;">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073711037 9 0 511 0;}
@font-face
{font-family:Wingdings;
panose-1:2 0 5 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1107305727 0 0 415 0;}
@font-face
{font-family:"MS Mincho";
mso-font-alt:"MS 明朝";
mso-font-charset:128;
mso-generic-font-family:modern;
mso-font-pitch:fixed;
mso-font-signature:-536870145 1791491579 18 0 131231 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0cm;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:34;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:JA;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:10.0pt;
mso-ansi-font-size:10.0pt;
mso-bidi-font-size:10.0pt;
mso-fareast-font-family:"MS Mincho";
mso-fareast-language:EN-GB;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;
mso-header-margin:36.0pt;
mso-footer-margin:36.0pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1780252142;
mso-list-type:hybrid;
mso-list-template-ids:-754803822 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
-->
</style>
</div>
<div class="MsoNormal" style="font-family: inherit;">
Data from social media must be linked in three ways:</div>
<div class="MsoListParagraphCxSpFirst" style="font-family: inherit; text-indent: -18pt;">
·<span style="-moz-font-feature-settings: normal; -moz-font-language-override: normal; font-size-adjust: none; font-size: 7pt; font-stretch: normal; font-style: normal; font-variant: normal; font-weight: normal; line-height: normal;">
</span>Within the social media itself</div>
<div class="MsoListParagraphCxSpMiddle" style="font-family: inherit; text-indent: -18pt;">
·<span style="-moz-font-feature-settings: normal; -moz-font-language-override: normal; font-size-adjust: none; font-size: 7pt; font-stretch: normal; font-style: normal; font-variant: normal; font-weight: normal; line-height: normal;">
</span>Across multiple social media</div>
<div class="MsoListParagraphCxSpLast" style="font-family: inherit; text-indent: -18pt;">
·<span style="-moz-font-feature-settings: normal; -moz-font-language-override: normal; font-size-adjust: none; font-size: 7pt; font-stretch: normal; font-style: normal; font-variant: normal; font-weight: normal; line-height: normal;">
</span>Between social media and the bank’s core data</div>
<div class="MsoNormal" style="font-family: inherit;">
<br /></div>
<div class="MsoNormal" style="font-family: inherit;">
The most secure forms of linking are to use unique
references: email addresses, IP addresses and telephone numbers. This can be supported by direct access
methods (i.e. asking the user for their Twitter name, or persuading them to
Like the bank on Facebook from within a known environment).</div>
<div class="MsoNormal" style="font-family: inherit;">
<br /></div>
<div style="font-family: inherit;">
However, even then the confidence in the link must be
evaluated and recorded: this information is user provided and may be wrong in
some cases. <span style="font-size: 12pt;">The notion of a “soft match” should be adopted – we think that this is
the same person, but we cannot be sure.</span></div>
<div style="font-family: inherit;">
<br /></div>
<div style="font-family: inherit;">
I would like to end this post with a recommendation to read the following white paper by John Lovett from <a href="http://www.webanalyticsdemystified.com/" target="_blank">Web Analytics Demystified</a> <a href="http://goo.gl/4Y4yF" target="_blank"><i><b>Beyond Surface-Level Social Media</b></i></a>. Lovett, who has written a book on <a href="http://www.amazon.co.uk/Social-Media-Metrics-Secrets-Lovett/dp/0470936274/ref=sr_1_1?ie=UTF8&qid=1339269747&sr=8-1" target="_blank">Social Analytics</a> , lays out a compelling vision for Deeper Social Analytics for companies. He clearly presents the value for companies to go beyond surface level analytics of likes, followers and friends and challenges you to ask deeper and more important questions. This white paper has been sponsored by Teradata Aster and is available for free from <a href="http://goo.gl/4Y4yF" target="_blank">here</a>.</div>
<div style="font-family: inherit;">
<br /></div>
<div style="font-family: inherit;">
In reading this white paper you will gain an understanding of the term 'Surface-Level Social Media' coined by John and how it is possible to gain competitive advantage even operating at this level. He will outline how Generation-Next Marketing is being powered by Social Analytics backed up with a number of interesting customer examples. He goes on to outline a 7 point strategy to build your deeper social media strategy. Finally John concludes with how unstructured data can yield valuable customer intelligence.</div>
<div style="font-family: inherit;">
<br /></div>
<div style="font-family: inherit;">
I found it to be very informative and well written and gave me a number
of new insights and points to ponder. I would be interested in your
thoughts on it too. </div>
<div style="font-family: inherit;">
<br /></div>
<div style="font-family: inherit;">
Enjoy!</div>
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<div class="MsoListParagraphCxSpLast" style="margin-left: 18pt; text-indent: -18pt;">
<br /></div>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com2tag:blogger.com,1999:blog-36349144.post-69773239085508625162012-05-23T15:49:00.001+01:002012-05-23T15:54:55.295+01:00Upcoming WebCast: Bridging the Gap--SQL and MapReduce for Big Analytics<br />
<table border="0" cellpadding="0" cellspacing="0" style="font-family: Calibri;"><tbody>
<tr><td><br />
<span class="Apple-style-span" style="color: black; font-family: inherit; line-height: 16px;">On Tuesday May 29th, Teradata Aster will be hosting a web cast to discuss the <b style="font-style: italic;">Bridging the Gap--SQL and MapReduce for Big Analytics</b>. Expected duration is 60 minutes and will start at 15:00 CET (Paris,Frankfurt) 14:00 UTC (London). You can register for free <a href="http://goo.gl/e8mV8">here</a>.<br /><br />We had run this seminar earlier in May but at a time which was more convenient for a US audience. The seminar was well attended and we received good feedback from attendees that encouraged us to rerun it again with some minor changes and at a time more convenient for people in Europe.<br /><br />If you are considering a big data strategy, confused by all the hype that is out there, believe that Map Reduce = Hadoop? or Hive = SQL?, Then this is an ideal event for a business user to get a summary of the key challenges, the sort of solutions that are out there and the novel and innovative approach that Teradata Aster has taken to maximise time to value for companies considering their first Big Data initiatives.</span><br />
<div style="color: black; line-height: 16px;">
<span class="Apple-style-span" style="font-family: inherit;">I will be the moderator for the event, and will introduce Rick F. van der Lans, independent analyst and Managing Director of R20/Consultancy, based in the Netherlands. Rick <span class="Apple-style-span" style="line-height: normal;"> is an independent analyst, consultant, author and lecturer specializing in Data Warehousing, Business Intelligence, Service Oriented Architectures, and Database Technology. He will be followed by Christopher Hillman from Teradata. Chris, is based in the United Kingdom and recently joined us a Principal Data Scientist. We will have time at the end to address questions from attendees.</span></span></div>
<div style="color: black; line-height: 16px;">
<span class="Apple-style-span" style="line-height: normal;"><span class="Apple-style-span" style="font-family: inherit;"><br /></span></span></div>
<div style="color: black; line-height: 16px;">
<span class="Apple-style-span" style="line-height: normal;"><span class="Apple-style-span" style="font-family: inherit;">During the session we will discuss the following topics:</span></span></div>
<br />
<ul>
<li><span class="Apple-style-span" style="line-height: 16px;"><span class="Apple-style-span" style="line-height: normal;"><span class="Apple-style-span" style="font-family: inherit;">Understanding MapReduce vs SQL, UDF's, and other analytic techniques</span></span></span></li>
</ul>
<ul>
<li><span class="Apple-style-span" style="line-height: 16px;"><span class="Apple-style-span" style="line-height: normal;"><span class="Apple-style-span" style="font-family: inherit;">How SQL developers and business analysts can become "data scientists"</span></span></span></li>
</ul>
<ul>
<li><span class="Apple-style-span" style="line-height: 16px;"><span class="Apple-style-span" style="line-height: normal;"><span class="Apple-style-span" style="font-family: inherit;">Fitting MapReduce into your BI/DW technology stack</span></span></span></li>
</ul>
<ul>
<li><span class="Apple-style-span" style="line-height: 16px;"><span class="Apple-style-span" style="line-height: normal;"><span class="Apple-style-span" style="font-family: inherit;">Making the power of MapReduce available to the larger business community</span></span></span></li>
</ul>
<br />
<div>
<br /></div>
<span class="Apple-style-span" style="font-family: inherit;">So come join us on May 29th. It will be an hour of your time well invested. Register for free <a href="http://goo.gl/e8mV8">here</a>.</span><br />
<span class="Apple-style-span" style="font-size: x-small;"><span class="Apple-style-span" style="font-family: inherit;"><span class="Apple-style-span" style="line-height: 16px;"><br /></span></span></span><br />
<span class="Apple-style-span" style="font-size: x-small;"><span class="Apple-style-span" style="font-family: inherit;"><br /></span></span></td></tr>
</tbody></table>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com2tag:blogger.com,1999:blog-36349144.post-81113804891417951032012-05-11T17:49:00.000+01:002012-05-12T07:02:05.469+01:00Big Data Analytics SIG - Teradata Universe Dublin April 2012At the recent Teradata Universe Conference held in Dublin, Duncan Ross, Simona Firmo and I organised a Special Interest Group (SIG) devoted to Big Data Analytics. We were lucky in the high quality speakers and panelists we had as well as the large attendance of delegates on the last day of the conference. I thought I would try to summarise my reflections from the session.<br />
<br />
You can find an overview of the SIG <a href="http://www.teradataemea.com/universe/analytics-and-big-data.html">here</a>.<br />
<br />
We kicked off with a presentation from Duncan, to set the scene for the session - <span class="Apple-style-span" style="font-family: inherit;"><i><span class="Apple-style-span" style="line-height: 15px;">Every journey starts with an idea / </span></i></span><i><span class="Apple-style-span" style="line-height: 15px;">Seven ideas for starting your Big Data journey</span></i><br />
<br />
Duncan chose to give his presentation via Prezi. You will find a copy of his presentation <a href="http://prezi.com/f0_a6irx8wyx/every-journey-starts-with-an-idea/?auth_key=8a5f1873e96cd6ae98d18f27e28dea37859c9672">here</a>. This was an interesting departure from the traditional M$ Powerpoint, and intrigued me enough to plan on using it for a future presentation myself. Certainly the transition between bullet points is more dramatic which some people like and others find nauseating in equal measure :-)<br />
<br />
So the 7 ideas that Duncan presented were:<br />
<br />
<ol>
<li>Data exhaust</li>
<li>Crowd Sourcing</li>
<li>Location</li>
<li>Gamification</li>
<li>Self knowledge</li>
<ol>
<li>Quantified Self</li>
<li>Consumer Data Locker</li>
</ol>
<li>Data Markets</li>
<li>Open Data</li>
</ol>
<div>
I guess you could consider that 8 ideas Duncan! This presentation suitably warmed up the attendees for presentations from Tom Fastner on <i>Do More with your Data: Deep Analytics</i>. It is fantastic to learn about the scale at which eBay operates. The have an EDW on Teradata at 8+ PB, a Teradata system they call Singularity, for semi structured data at 42+ PB and unstructured data in Hadoop at 50+ PB. It was also interesting to see that the concurrent user population ranged from 500+ with the EDW, to 150+ with the singularity system to 5-10 on Hadoop. He also talked about their behaviour data flow and the value of compression to them.</div>
<div>
<br /></div>
<div>
<span class="Apple-style-span" style="font-family: inherit;">This was followed by an equally interesting presentation by Professor Mark Whitehorn from the University of Dundee who was ably assisted by Chris Hillman a former student, who recently joined Teradata EMEA as a Principal Data Scientist. I found their presentation fascinating on their research work at Dundee on <i>Proteomics: Science, Data Science and Analytics. </i>Chris turned out to be a true geek, admitting to having built his own Hadoop cluster at home. Rest assured I have since converted him to the even more powerful and productive environment of <span class="Apple-style-span" style="color: orange;">Teradata</span> <span class="Apple-style-span" style="color: #990000;">Aster</span>. I wasn't sure about his Hadoop cluster at home, but he sent me proof...</span></div>
<div>
<span class="Apple-style-span" style="font-family: Calibri;"><br /></span></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj2DHZ-kfVnC8_ggrLE_jfAoYSNKgS80PpoZpH1yVEctTIfzmdD8iSCFfE9HesIm7r9jQ9Gpz2dqkLh7_xQ0plBCd-pN-v6mmbTjsjKM_AoRAGA6o6trQi1NONOizkIIvN_e06wJw/s1600/ChrisHadoop.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="240" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj2DHZ-kfVnC8_ggrLE_jfAoYSNKgS80PpoZpH1yVEctTIfzmdD8iSCFfE9HesIm7r9jQ9Gpz2dqkLh7_xQ0plBCd-pN-v6mmbTjsjKM_AoRAGA6o6trQi1NONOizkIIvN_e06wJw/s320/ChrisHadoop.png" width="320" /></a></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
<span class="Apple-style-span" style="font-family: inherit;">Their presentation outlined some of the possibilities of using Big Data analytics techniques on Proteomics, that could lead to dramatic improvements in drug discovery and shorten the drug development lifecycle. While this is a highly complicated area, it really outlines an innovative and possible very critical use case for big data analytics. I learnt that Mass Spectrometry generates 7GB of raw data per 4 hours and in excess of 15 TB per year that needs to be analysed and that's from only one machine! Teradata is working with university to bring this research forward. Stay tuned for more updates in this area in the future.</span></div>
<div class="separator" style="clear: both; text-align: left;">
<span class="Apple-style-span" style="font-family: inherit;"><br /></span></div>
<div class="separator" style="clear: both; text-align: left;">
<span class="Apple-style-span" style="font-family: inherit;">We then moved onto a panel session and our speakers where joined by Navdeep Alam from Mzinga, a Teradata Aster customer, who presented earlier in the week and our very own Dr. Judy Bayer from Teradata. We were hoping for a provocative panel session, so we set the title as: <i>Big Data and Analytics for Greater Competitive advantage</i></span></div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgkbPOHBZoYgBgd8mGukGZfJ3L4f95dHt1gZHrmNHUfNsbgXDGzZj-9lp6JBODGLudk8x5fW7etT1XHk5ylTFT8yWXCvbGY_MoZ2z3TAytLNWoKxFGKKcCMvLeokycQl1zThVd2gg/s1600/PanelSession.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="238" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgkbPOHBZoYgBgd8mGukGZfJ3L4f95dHt1gZHrmNHUfNsbgXDGzZj-9lp6JBODGLudk8x5fW7etT1XHk5ylTFT8yWXCvbGY_MoZ2z3TAytLNWoKxFGKKcCMvLeokycQl1zThVd2gg/s320/PanelSession.jpg" width="320" /></a></div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
Duncan and I brainstormed some questions in advance to kick off the panel session. The questions we posed were:</div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
Q. What is the <span class="Apple-style-span" style="color: red;">one word</span> that sums up Big data for you?</div>
<div class="separator" style="clear: both; text-align: left;">
Q. What makes a good Data Scientist?</div>
<div class="separator" style="clear: both; text-align: left;">
</div>
<ul>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Curious, </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">open mind, </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">good communicator, </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">creativity, </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">passion for finding the stories in the data</span></li>
</ul>
<br />
<div class="separator" style="clear: both; text-align: left;">
Q. What is the most important Big Data Analytical Technology and why?</div>
<div class="separator" style="clear: both; text-align: left;">
</div>
<ul>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">MPP</span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Fault Tolerance </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">R </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Visualisation </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Path Analysis </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Ecosystem</span></li>
</ul>
<br />
<div class="separator" style="clear: both; text-align: left;">
Q. If Big Data Fails in 2012 what will be its cause?</div>
<div class="separator" style="clear: both; text-align: left;">
</div>
<ul>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Data Silos</span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Stupidity :-) </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Lack of skilled people </span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Unreasonable expectations?</span></li>
</ul>
<br />
<div class="separator" style="clear: both; text-align: left;">
Q. If you were starting a Big Data project tomorrow (<span class="Apple-style-span" style="color: lime;">and could choose to do anything</span>)</div>
<div class="separator" style="clear: both; text-align: left;">
what would you do?</div>
<div class="separator" style="clear: both; text-align: left;">
</div>
<ul>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Study the universe</span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Proteomics</span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Natural Language Processing</span></li>
<li><span class="Apple-style-span" style="font-family: HelveticaNeue, 'Helvetica Neue', Helvetica, Arial, sans-serif; font-size: 14px; line-height: 18px;">Projects to benefit society</span></li>
</ul>
<br />
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>
<div class="separator" style="clear: both; text-align: left;">
Did you attend this SIG? If so, what were your impressions?</div>
<div class="separator" style="clear: both; text-align: left;">
<br /></div>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0tag:blogger.com,1999:blog-36349144.post-37081011322679987702012-04-22T19:29:00.000+01:002012-04-22T19:29:11.563+01:00Teradata Universe - DublinBack in Dublin, for the Teradata Universe Conference. Looking forward to talking with customers and colleagues from around Europe.<br />
<br />
We have a booth for Aster, as part of the main Teradata booth on the Expo floor. Went to check it out today and get it ready. Looks good. You'll find me or Vic Winch or Mike Whelan there. Drop by to say hello. This is how it looks post setup<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="http://2.bp.blogspot.com/-Y26nFRpb62M/T5Qpr3geBhI/AAAAAAAAAIA/yuXKwxZn3Jg/s1600/Teradata+Universe+-+4.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="239" src="http://2.bp.blogspot.com/-Y26nFRpb62M/T5Qpr3geBhI/AAAAAAAAAIA/yuXKwxZn3Jg/s320/Teradata+Universe+-+4.jpg" width="320" /></a><a href="http://4.bp.blogspot.com/-MceSMR2yFq4/T5QpsipvUCI/AAAAAAAAAIg/62mjjG51lAA/s1600/Teradata+Universe+-+8.jpg" imageanchor="1" style="clear: right; float: right; margin-bottom: 1em; margin-left: 1em;"><img border="0" height="239" src="http://4.bp.blogspot.com/-MceSMR2yFq4/T5QpsipvUCI/AAAAAAAAAIg/62mjjG51lAA/s320/Teradata+Universe+-+8.jpg" width="320" /></a></div>
<br />
<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
</div>
<div class="separator" style="clear: both; text-align: center;">
<a href="http://4.bp.blogspot.com/-5N6CAKLEGFg/T5Qpsg1QuII/AAAAAAAAAIc/n-2TjgWhW7I/s1600/Teradata+Universe+-+9.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="239" src="http://4.bp.blogspot.com/-5N6CAKLEGFg/T5Qpsg1QuII/AAAAAAAAAIc/n-2TjgWhW7I/s320/Teradata+Universe+-+9.jpg" width="320" /></a></div>
<br />
And from the outside, all quiet at the moment as it is Sunday afternoon<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="http://1.bp.blogspot.com/-VKhoWb8Cgeg/T5QprHVHjyI/AAAAAAAAAH4/xfAikS2My44/s1600/Teradata+Universe+-+2.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="320" src="http://1.bp.blogspot.com/-VKhoWb8Cgeg/T5QprHVHjyI/AAAAAAAAAH4/xfAikS2My44/s320/Teradata+Universe+-+2.jpg" width="239" /></a></div>
<br />
On the Wednesday Duncan Ross & I will host the <a href="http://www.teradataemea.com/universe/analytics-and-big-data.html">Analytics for Big Data SIG</a><br />
<br />
It is going to be a very busy week!<br />
<br />Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0tag:blogger.com,1999:blog-36349144.post-12472188038705248052012-04-20T13:16:00.002+01:002012-04-20T14:56:23.647+01:00Navigating the hype around Big Data to yield business value from it<div class="MsoNormal">
As the Big Data
phenomenon continues to gather momentum, more and more organizations are
starting to recognize the unexploited value in the vast amounts of data they
hold. According to IDC, the Big Data technology and services market will grow
to about $17 billion by 2015, seven times the growth rate of the overall IT
market.</div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
Despite the strong
potential commercial advantage for business, developing an effective strategy
to cope with existing and previously unexplored information could prove tough
for many enterprises. </div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
In many ways, this is
because the term ‘Big Data’ itself is somewhat misleading. One definition is in
terms of terabytes and petabytes of information that common database software
tools cannot capture, manage and process within an acceptable amount of time.
In reality, data volume is just one aspect of the discussion and arguably the
most straightforward issue that needs to be addressed. </div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
As Gartner points out;
‘the complexity, variety and velocity with which it is delivered combine to
amplify the problem substantially beyond the simple issues of volume implied by
the popular term Big Data.’ For this reason, ‘big’ really depends on the
starting point and the size of the organization.</div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
<span lang="EN-US">With so much being written about Big Data
these days, it can prove difficult for enterprises to implement strategies that
deliver on the promise of Big Data Analytics. For example I have read many
online articles equating "MapReduce" with "Hadoop" and
"Hadoop" with "Big Data". </span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
<span lang="EN-US">MapReduce is, of course, a programming
model that enables complex processing logic expressed in Java and other
programming languages to be parallelised efficiently, thus permitting their
execution on "shared nothing", scale-out hardware architectures and
Hadoop is <b><i>one</i></b> implementation of the MapReduce programming
model. There are other implementations of the MapReduce model – and there
are other approaches to parallel processing, which are a better fit with many
classes of analytic problems. However we rarely see these alternatives
discussed.</span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
<span lang="EN-US">Another interesting assertion I read and sometimes
I am confronted with by customers new to Hadoop is the positioning of Hadoop as
an alternative to existing, SQL-based technologies that is likely to displace –
or even entirely replace – these technologies. This can often lead to an
interesting discussion, but you could summarize that Hadoop lacks important
capabilities found in a mature and sophisticated data warehouse RDBMS, for
example: query re-write and cost-based query optimization; mixed-workload
management; security, availability and recoverability features; support for
transactions; etc., etc., etc. </span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
<span lang="EN-US">There is, of course, a whole ecosystem
springing-up around Hadoop – including HBase, Hive, Mahout and ZooKeeper, to
name just four – and some commentators argue that in time these technologies
may extend Hadoop to the point where this ecosystem <b><i>could</i></b> provide
an alternative to existing Data Warehouse DBMS technology. Possibly, but I
would suggest that they have a long an arduous path to reach such a goal. </span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
<span lang="EN-US">None of which is to say that Hadoop is not
an extremely interesting and promising new technology – because clearly it is,
and has role as enterprises embrace Big Data Analytics. There is evidence
today, from leading e-business companies that Hadoop scales well - and has a
unit-cost-of-storage that will increasingly make it possible for organizations
to "remember everything", by enabling them to retain data whose value
for analytics is as yet unproven.</span></div>
<div class="MsoNormal">
<span lang="EN-US"> </span></div>
<div class="MsoNormal">
<span lang="EN-US">Hadoop may become the processing
infrastructure that enables us to process raw, multi-structured data and move
it into a "Big Analytic" environment - like Teradata-Aster - that can
more efficiently support high-performance, high concurrency manipulation of the
data, whilst also providing for improved usability and manageability, so that
we can bring this data to a wider audience. The final stage in this “Big
Data value chain” will the see us move the insights derived from the processing
of the raw multi-structured data in these "up stream" environments
into the Data Warehouse, where it can most easily and most efficiently be
combined with other data - and shared with the entire organization, so in order
to maximize business value.</span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
<span lang="EN-US">Teradata continues to invest in
partnerships with leading Hadoop distributors Cloudera and Hortonworks - and to
develop and enhance integration technology between these environments and the
Teradata and Teradata-Aster platforms.</span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
The fact that Big Data
is discovery-oriented and its relative immaturity compared with traditional
analytics, arguably means that it doesn’t sit well within the IT department
because requirements can never be fully defined in advance. Neither should it
logically fall to business analysts used to using traditional BI tools. </div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
As a result, a new
role has emerged for data scientists, who are not technologists but are also
not afraid of leveraging technology. Rather than seeking an answer to a
business question, this new professional is more concerned with what the
question should be. The data scientist will look for new insights from data and
will use it as a visualization tool not a reporting tool. </div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
In future, many
believe that having this type of individual on staff will also be key to
generating maximum value from Big Data. In the meantime, the onus will
invariably fall to the CIO to prepare and act for a changing Big Data
landscape.</div>
<div class="MsoNormal">
<br /></div>
<div class="MsoNormal">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:roman;
mso-font-format:other;
mso-font-pitch:fixed;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0cm;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:"Times New Roman";
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-ansi-language:EN-US;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:10.0pt;
mso-ansi-font-size:10.0pt;
mso-bidi-font-size:10.0pt;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-ansi-language:EN-US;
mso-fareast-language:JA;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;
mso-header-margin:36.0pt;
mso-footer-margin:36.0pt;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
</div>
<div class="MsoNormal">
Customers can be
assured that Teradata will continue to be their #1 strategic advisor for their
data management and analytics. We continue to provide compelling and innovative
solutions with Teradata Aster and Teradata IDW appliances. We will also work
with best-in-class partners to provide choices in integrated solutions and
reference architectures to help customers maintain competitive advantage with
their data.</div>
<div class="MsoNormal">
<br /></div>
<span style="font-family: "Times New Roman"; font-size: 12pt;">What is certain is that
interesting times lay ahead, and that those enterprises that can successfully
execute a Big Data strategy will gain competitive advantage from the valuable
insights gained from Big Data Analytics.</span>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0Sherfield on Loddon, Hampshire, UK51.31795 -1.024022951.298102 -1.0635049 51.337798000000006 -0.9845409tag:blogger.com,1999:blog-36349144.post-31758220870355411262012-04-20T12:27:00.001+01:002012-04-20T12:27:30.171+01:00Signing back on...Wow... Has it been nearly 5 years since my last post... <br />
<br />
Well it has been an incredibly interesting and challenging time, Spent time with Informatica as VP of R&D for their Data Quality business. Met some great guys and learned a lot. Moved then to working for Pocket Kings (company behind Full Tilt Poker) as Director of Database systems. First time in my career on the customer/IT side of the fence. It was challenging, but working with very bright and committed people you learn a lot. It is also where I got the bug about Big Data through running an Aster Data nCluster 30+TB, 40+ nodes. After Teradata acquired Aster Data about a year ago I was lucky to get offered a position to spearhead the adoption of Aster Data in EMEA, both internally within Teradata and also with the Teradata customer base.<br />
<br />
I am now living and working in the UK. I am still an Apple nut, still a Porsche nut, maybe still a nut period :-)<br />
<br />
So what you can expect from this blog is my musings on Big Data and insight gleaned from working with customers to deliver business value from Big Data. I still also probably post about my passion for Porsche, I'm lucky to have a tweaked (540 bhp) 996 Turbo as my daily driver.<br />
<br />
Enjoy and I welcome your feedback...Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0Sherfield on Loddon, Hampshire, UK51.31795 -1.024022951.298102 -1.0635049 51.337798000000006 -0.9845409tag:blogger.com,1999:blog-36349144.post-37389675679846398872007-07-13T14:29:00.000+01:002007-07-13T14:48:42.154+01:00Oracle Ireland employee # 74 signing off...I will shortly be starting my life outside Oracle after some 15 years there. My last day is today.<br /><br />I've enjoyed it immensely and am proud of our accomplishments. It really doesn't seem like 15 years, and I have been lucky to work on some very exciting projects with some very clever people, many of whom have become friends. I look forward to hearing about all the new releases coming from Database Tools in the future.<br /><br />Next it is two weeks holidays in France (I hope the weather gets better!) and then the beginning of my next adventure in a new company. More on that later.<br /><br />I think I'll continue to blog on database tools topics.Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com6tag:blogger.com,1999:blog-36349144.post-38453923929006312942007-07-04T15:05:00.000+01:002007-07-04T18:58:51.697+01:00Access migration to Application Express without direct SQL AccessI got asked a question recently how to complete an Access migration when you don't have direct SQL access to the Oracle instance where Oracle Application Express is installed (e.g. apex.oracle.com)?<br /><br />For dealing with the application part, it is not an issue as the Application Migration Workshop feature of APEX (3.0+) allows you to load the results from the <span style="font-style: italic;">Oracle Migration Workbench Exporter for Microsoft Access</span>, so you can capture the meta data for Access Forms and Reports. You can even download a copy of the exporter from the workshop itself.<br /><br />The challenge is really the schema and data migration part using Oracle SQL Developer (1.2+). By default SQL Developer expects to be able to make a SQL connection to the target Oracle database. However I did think about this use case as we were designing this new Migration Workbench tool. I will describe a solution below.<br /><br />The only requirement, is that you have SQL access to any Oracle database (9iR2+), because the workbench is driven using an underlying migration repository. You could use the Express Edition of Oracle for this purpose, which is totally free, if you didn't have SQL access to an existing Oracle database.<br /><br />So let me outline the main steps involved:<br /><ol><li>Start SQL Developer 1.2</li><li>Make sure you set the following preference: Tools -> Preferences -> Migration -> Generation Options: <span style="font-style: italic;">Least Privilege Schema Migration</span><br /></li><li>Create a connection to your Access database. Make sure you can browse the tables in the access database and see the data</li><li>Export the table data to csv format: For each table you want to migrate, use the context menu associated with tables to export as csv format. Make sure you select an encoding that matches your target database. I try to keep everything in UTF-8</li><li>Create a connection to an Oracle schema.</li><li>Create a migration repository in this connection. You can do this via the context menu on a connection</li><li>From your Access connection, context menu, select: <span style="font-style: italic;">Capture Microsoft Access</span>. This will launch the exporter and initiate the capture step of the migration.</li><li>Take your captured model and now create an Oracle (converted) model by selecting the captured model and via the context menu: <span style="font-style: italic;">Convert to Oracle Model</span></li><li><span style="font-style: italic;"><span style="font-style: italic;"></span></span>With you converted model, you can now create an object creation script using the context menu: <span style="font-style: italic;">Generate</span></li><li>The result of step 9 is presented in a SQL Worksheet, you can edit this to remove objects you are not interested in, then via File -> Save As, save the contents to a SQL file.</li><li>Login to your APEX Workspace</li><li>To execute the object creation script you have just created. Goto SQL Workshop -> SQL Scripts -> Upload.<br /></li><li>Once the script is uploaded, View it and select the RUN action. This should create all your schema objects, view the results to make sure all the object were create successfully. You now be able to view these schema objects in the <span style="font-style: italic;">SQL Workshop -> Object Browser.</span></li><li>To load our CSV files we will use the Utilities -> Data Load/Unload -> Load, selecting <span style="font-style: italic;">Load Spreadsheet Data</span>. You will do this for each table we want to load data into. Select <span style="font-style: italic;">Load To : Existing Table</span> and <span style="font-style: italic;">Load From: Upload File</span>. You may need to apply appropriate format masks to get the data to load properly.</li></ol>Notes:<br /><ol><li>You should complete the schema and data migration part of your migration, prior to creating a migration project via the Application Migration Workshop.</li><li>You may have some post migration cleanup steps, if you had access auto increment columns in your tables, you will need to reset the values of the sequences we have created.</li><li>Another option to explore depending on your data, would be to export the data from Access tables as SQL INSERT statements, and then it just a simple matter of loading and run that SQL script via apex.</li></ol>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com1tag:blogger.com,1999:blog-36349144.post-35091141768816856992007-06-27T13:02:00.001+01:002007-06-27T13:55:28.031+01:00Its summer, time to bring the car out for a good driveAt the weekends, there is nothing better than taking out my Porsche for a long drive drive in the countryside. Much better, than my daily commute! I am a member of the Porsche Club of Ireland, and we had a great drive through the Wicklow mountains recently. The weather wasn't great but the scenery is still dramatic, lots of narrow twisting mountains roads to allow you to eke out the maximum enjoyment. It was fathers day so the kids decided they would both come with me, which was great.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhPot-I8WqpOLKh4bUcR14Mbkxm7vv-mrnrbqqp4BO0SUe9UBVIB4pHr982X4AWW24EN6WooA-a3OCNlCBSyc5YMtTKHbr54u-bNIxzf4Ti5Y4LzZ4UxN5ZqCW2UwJOfSl4PmnVIA/s1600-h/kids&meJune07s.jpg"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhPot-I8WqpOLKh4bUcR14Mbkxm7vv-mrnrbqqp4BO0SUe9UBVIB4pHr982X4AWW24EN6WooA-a3OCNlCBSyc5YMtTKHbr54u-bNIxzf4Ti5Y4LzZ4UxN5ZqCW2UwJOfSl4PmnVIA/s320/kids&meJune07s.jpg" alt="" id="BLOGGER_PHOTO_ID_5080724798907442066" border="0" /></a>I think we had over 15 members cars out that day. Everybody is very friendly, with a passion for all things Porsche. We started out from the Porsche Center in Dublin and they graciously provided us with coffee before we started and allowed us to gaze over all the new models. Out of my price range of course!<br /><br />It was a real fun day and I look forward to the next event. We post the pictures from these "drives" on the club <a href="http://content.us.porsche-clubs.porsche.com/PorscheClubs/pc_ireland/pc_main.nsf/web/C1256FA500591CD4C12570E0004B285C">web site</a>.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj_7ZlDm2OItsMNL9M5TctzzS1PRy7lUkrn5tO9iVEKt9Lhc4I0XOaup3Pz6s-cG25NIYL2a677xgj8sYk_y4-3Li-NmRS-jHSZ5QS4SW8WxbPddjCkUpmfDESZ_hFJtv_3ufUoEA/s1600-h/Wicklow+2007-+037S.JPG"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj_7ZlDm2OItsMNL9M5TctzzS1PRy7lUkrn5tO9iVEKt9Lhc4I0XOaup3Pz6s-cG25NIYL2a677xgj8sYk_y4-3Li-NmRS-jHSZ5QS4SW8WxbPddjCkUpmfDESZ_hFJtv_3ufUoEA/s320/Wicklow+2007-+037S.JPG" alt="" id="BLOGGER_PHOTO_ID_5080726589908804514" border="0" /></a>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com2tag:blogger.com,1999:blog-36349144.post-90570168755386816432007-06-21T19:41:00.000+01:002007-06-26T18:55:09.569+01:00Oracle Database Plugin for the Eclipse Data Tools PlatformAs a further commitment to the Eclipse Community, Oracle announces an early adopter release of the <a href="http://oss.oracle.com/dbplugin-eclipse-dtp.html">Oracle Database Plugin for Eclipse Data Tools Platform</a>. This plugin extends the Eclipse Data Tools Platform to connect to and work with Oracle database objects. The initial plugin supports the ability to connect to Oracle Databases, navigate through all database objects, execute stored procedures and functions, and view textual and graphical execution plans.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://www.oracle.com/technology/tech/eclipse/dtp/images/Table-Editor.png"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiaRdviwh8OcEkyNMcxFEQth_bX4gY0zQAe1kAiQpPA_5tSwIJFYB0KHegkETyxChCp9RLChr5lCULxuz8ziZyVkEDXm9kEjcSiQqqYgdfIxmoNrLW0qL9WA08p_gkPi9wIrDne9w/s320/Table-Editor2_thmb.png" alt="" id="BLOGGER_PHOTO_ID_5078591096337336146" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://www.oracle.com/technology/tech/eclipse/dtp/images/Exec-GraphPlan.png"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh1Nyzx6ykSGVmMCTSGSJteiJpiX4fgXczvrlFSAXTgPqz_D2pAU-_IIJYwehDqsIbciWnln1uO4pbe9BOGtV9JPLri_a6RBdeOQX45eqBIL9zo0x7O3dcTgSI95i65odjBJ5qUzw/s320/Exec-GraphPlan_thmb.png" alt="" id="BLOGGER_PHOTO_ID_5078591208006485858" border="0" /></a><br />This release has been tested against DTP 1.0. We will revise the plugin as required once DTP 1.5 is released as part of the imminent Eclipse Euorpa release.<br /><br />Oracle has published a <a href="http://www.oracle.com/technology/tech/eclipse/dtp/files/oracledatabasepluginforeclipsedtp_sod.htm">Statement of Direction</a> which outlines our future plans.<br /><span class="bodycopy"><br />Feedback from the community is important to us so Oracle has created a <a href="http://forums.oracle.com/forums/forum.jspa?forumID=393">forum</a> on OTN to provide a means for this feedback to be collected and allow Oracle to respond. Assuming a positive level of interest from the community, we would seek to formally join the DTP project for the purpose of contributing to the Connectivity, Model Base, SQL Development Tools and particularly the Enablement subproject to provide specialized support for the Oracle Database.</span>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com5tag:blogger.com,1999:blog-36349144.post-20702087245423006222007-06-08T10:24:00.000+01:002007-06-08T13:52:08.807+01:00Oracle Database Migration has reached the next level!SQL Developer 1.2 is now production and with it our new integrated migration workbench. Find out more information on OTN <a href="http://www.oracle.com/technology/tech/migration//workbench/index_sqldev_omwb.html">here</a>. Over the last 6 months or so as I have talked about this new product, I used the tag line "Taking database migration to the next level", well... I think we are there now. We are the first database vendor to provide an integrated migration tool into a developers IDE with all of the resulting productivity benefits this brings.<br /><br /><div style="text-align: right;"><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://www.oracle.com/technology/tech/migration/workbench/images/quickmigrate.png"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer; width: 230px; height: 173px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjuUdcD7XSjrJUWPcd-tXSi2WbTLfEgVRL_oySyumYh0eFzyjc_GVXLqENncIRaoSCHS5z-K39A1qGL3N4qsovHHSbcHqC8U8yQd6SQVlMV0VGWIPUgxHG7xGqLGunUXp32xXxJNQ/s320/quickmigrate_thmb.png" alt="" id="BLOGGER_PHOTO_ID_5073623876465198882" border="0" /></a><br /></div><div style="text-align: left;"><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://www.oracle.com/technology/tech/migration/workbench/images/TranslationScratchEditor.png"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer; width: 229px; height: 169px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjPuU1-9bc3rJu_EZz1LwFD5yUdJV4Dp-tl-AmGPD-HG2hpng33N2tCXnQwPin_YccHP1KzgaPPtLWQpjibuHQWT198NWPyNGIHk_PdSETDZzosXIvK8SO7ARp3hvml46yWJH_Vcw/s320/TranslationScratchEditor_thmb.png" alt="" id="BLOGGER_PHOTO_ID_5073623992429315890" border="0" /></a><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://www.oracle.com/technology/tech/migration/workbench/images/translationdiffviewer.png"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer; width: 224px; height: 166px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEisXTFuPToKCbs5oNqaHKGPe1dPRJOk6Gwo4Q41Vza68I1MuMM4a1BXz77LXgYTC9QzxHVg8x4O8kMa2m5KaGk4gObupaZSARrMQmy83DeiNoLEUfpoc12-7J39g24DKNCzyhUZiA/s320/translationdiffviewer_thmb.png" alt="" id="BLOGGER_PHOTO_ID_5073624104098465602" border="0" /></a> The SQL Developer Migration Workbench is the tool to aid in the migration of third party databases onto the Oracle platform. This tool allows you to migrate your existing Microsoft Access, Microsoft SQL Server and MySQL databases (including schema objects, data and stored procedures/functions) to Oracle.<br /><br />Features of this production release include:<br /><ul><li>Enhanced user interface - This release harnesses the enhanced GUI environment of SQL Developer and works seamlessly with other SQL Developer components. This means that users have one tool to browse third-party databases, migrate selected objects to Oracle and then work with them.</li><li> Existing SQL Developer users should find the Migration Workbench familiar and easy to use.</li><li>Quick Migration Wizard provides the easiest and quickest means of doing a database migration.<br /></li><li>Step driven migration offers control at each stage of the migration process.</li><li>Fine grain migration support provides users with the ability to select specific objects for migration.</li><li>Least privilege migration - The ability to migrate objects from source to target without the need for dba rights. The workbench will migrate objects it has rights to view so does not require any special privileges to run.</li><li>Platform Supported:<br /></li><ul><li>Supports Microsoft Access versions 97, 2000, 2002/XP, 2003<br /> </li><li>Microsoft SQL Server 7, 2000, 2005<br /> </li><li>MySQL versions 3, 4, 5.</li></ul><li>Parallel Online data move - The ability to move the data using a number of parallel connections for increased throughput.</li><li>Offline data move script generation - Generates scripts to allow for export of source data and import to target database of offline data move. We also support offline capture as well.<br /></li><li>Language Translation Features - Supports translation of stored programs, procedures, functions, triggers, constraints and views defined in Transact SQL or Microsoft Access SQL.</li><li>Translation scratch editor - An interactive editing facility for Transact SQL and Microsoft Access SQL allowing for instant translation to PL/SQL or SQL. This editor supports both single-statement translation and translation of entire SQL scripts.</li><li>Translation difference viewer - Inline difference viewer for examining translated SQL. This viewer provides color coded side-by-side comparison of translated SQL to display semantic similarities between the source and translated code.</li><li>Any many more interesting features for you to find out about....<br /></li></ul>We have also prepared a number of online demos (viewlets) so you can see this new tool in action. Check them out on OTN <a href="http://www.oracle.com/technology/tech/migration/workbench/files/sdmwb_viewlets.html">here</a>.<br /><br />I am very proud of what my team has achieved with this release. A lot of work over the past year has gone into it. This is only the beginning, expect further innovative releases from the database tools team in the future.<br /><br />I would like to thank our early adopters who provided some very constructive feedback. Hopefully you see the results of your feedback in this production release.<br /><br /></div>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com3tag:blogger.com,1999:blog-36349144.post-22123262088280108242007-05-31T19:33:00.000+01:002007-05-31T19:57:08.820+01:00Access Migration TutorialAre you considering migrating that Microsoft Access application to Oracle Application Express? Well read on...<br /><br />Hopefully you are aware of Oracle SQL Developer and that we have redeveloped the Migration Workbench and integrated it tightly with Oracle SQL Developer. An early adopter version of this is available now and will be production very soon. More of that in a subsequent post.<br /><br />With Oracle Application Express 3.0 we introduced the Application Migration Workshop to assist with migrating your Access Forms & Reports. When I talk about this solution, I get asked do we have a step by step guide or methodology for such migrations. So, we have produced a <a href="http://www.oracle.com/technology/products/database/application_express/migrations/tutorial.html">migration tutorial</a> to address this and have published it on OTN.<br /><br /><font class="bodycopy">We have taken the Microsoft Access sample application, <font style="font-style: italic;">Northwind Traders</font> and migrated it to Oracle Application Express. The <a href="http://www.oracle.com/technology/products/database/application_express/migrations/oracle_application_express-application_migration_workshop.pdf">tutorial</a> covers this in step by step detail. Following this tutorial would be a useful exercise for any user that wishes to undertake migrating their applications from Microsoft Access to Oracle Application Express. We have called the converted application Southwind Wholesalers. :-)<br /><br />You can see it running on <a href="http://apex.oracle.com/pls/otn/f?p=19550">apex.oracle.com</a> and we have also provided it as a <a href="http://www.oracle.com/technology/products/database/application_express/migrations/southwind_wholesalers_1.0.zip">packaged application</a> so you can examine it in detail.</font>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0tag:blogger.com,1999:blog-36349144.post-46693641066947809972007-05-17T11:18:00.000+01:002007-05-17T19:20:41.023+01:00Updated Oracle SQL Developer Migration Workbench Early Adopter ReleaseWe have updated the early adopter release of Oracle SQL Developer Migration Workbench today on OTN. You can get it from <a href="http://www.oracle.com/technology/tech/migration//workbench/index_sqldev_omwb.html">here</a>. This is our final preview release, before we go production. We are now functionally complete for this initial production release and are now focused on fixing our final "show stopper" bugs. We have had good feedback from our user community via our <a href="http://apex.oracle.com/pls/otn/f?p=OMWBFDBK">feedback application</a> and also via the Workbench <a href="http://forums.oracle.com/forums/forum.jspa?forumID=1">forum</a>. They have uncovered a number of bugs, most of which we have now addressed (Oracle9i as a repository and Access data migration issues for example) and the remaining ones we will resolve prior to production. I encourage everybody to update to this latest release and continue to provide us with feedback.<br /><br />I have been working extensively with different builds of the Migration Workbench these past couple of weeks as we closed in on our goal to refresh the early adopter version. In my "biased" opinion is it looking much stronger and I would like to outline some of the new features in this updated early adopter release.<br /><br /><span style="font-weight: bold;">Quick Migrate</span><br />In the orginal Migration Workbench we had a wizard driven approach to simplify migrations and I felt it was important to bring this functionality back. With our Quick Migrate wizard, I believe we have improved from the original wizard, since we will leverage our least priviliege migration capabilities, assume sensible defaults and create/remove our migration repository.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjlZdL2L2KVTSoizN60tPVWHvS9Oo1Sep__RoqQhMEhxZg5skaEyRFgA0p4CfmAiQFYOL3zNLg3GvIhavsqRqFvZaYa5NJSoATNAJY_TyVeeEiSatBSgYCJDxPEv5x-7QIbTzYbzg/s1600-h/QuickMigrate.gif"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjlZdL2L2KVTSoizN60tPVWHvS9Oo1Sep__RoqQhMEhxZg5skaEyRFgA0p4CfmAiQFYOL3zNLg3GvIhavsqRqFvZaYa5NJSoATNAJY_TyVeeEiSatBSgYCJDxPEv5x-7QIbTzYbzg/s320/QuickMigrate.gif" alt="" id="BLOGGER_PHOTO_ID_5065482778351757618" border="0" /></a><br /><br />So if you have a schema on SQL Server or a single Access mdb file to migrate to an existing Oracle schema, this should be the easiest and quickest migration option for you. Another nice feature, if you are doing an access migration, is that we have added command line support to our exporter so, we will automatically launch the correct Access exporter for the Access connection that you specify.<br /><br /><span style="font-weight: bold;">Offline Capture<br /></span>This was a popular feature with our consultants and partner technical services folks, with the original Workbench, as it allowed them to work remote from the customer/partner. We have now added back in that feature.<br /><br /><span style="font-weight: bold;">Migration Reports</span><br />We have added in some initial migration reports available under Reports->Shared Reports. This will be an area we will add to into the future, as we can mine our rich metadata repository to provide you with useful information. If you have suggestions for additional reports let me know. I will also publish more details about our repository, so you can develop your own migration reports as well. Maybe we should have a competition for the best contributed report? I think we have a couple of 1GB USB keys left over from our Database Developer Day in Dublin I could use as prizes.<br /><br /><span style="font-weight: bold;">Translation Scratch Editor<br /></span>We have reworked this feature extensively. I originally wanted to add a feature that would enable you to validate our translated SQL. As we worked through different iterations of how best to implement this feature, we came up with the idea about leveraging our existing Worksheet capabilities, which I think is very cool and I am very pleased with how this turned out.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhi_mexN0ffzxrBvX8u5NP6bGzzQFC9egmTe70q1ZCq4C2wndVt_CLUo6uA8bphDgC7lhnoDMbtxTC7B_iEIHYgPDqqq2Feum473jSbKflNOqLV4sCM7MuttzUj24uRekMR3EGkXw/s1600-h/ScratchEditorgif.gif"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhi_mexN0ffzxrBvX8u5NP6bGzzQFC9egmTe70q1ZCq4C2wndVt_CLUo6uA8bphDgC7lhnoDMbtxTC7B_iEIHYgPDqqq2Feum473jSbKflNOqLV4sCM7MuttzUj24uRekMR3EGkXw/s320/ScratchEditorgif.gif" alt="" id="BLOGGER_PHOTO_ID_5065488370399177026" border="0" /></a><br />We have also done a lot of work to improve incremental capture and improve our filtering capabilities from our early adopter release. We have integrated our MySQL parser from the original Migration Workbench and will extend its capabilities in subsequent releases to be as functional as our new TSQL parser and also support SQL statement level translation. (workaround for now, within the scratch editor, is just wrap the SQL statement in a procedure). We have also implemented the ability to update your Access mdb file, to create link tables to point to your newly migrated schema. This was also a feature of the original workbench. We hope to add some additional usability tweaks to create an ODBC OSN on the fly and provide a select list of known Oracle DSN. Hopefully that will make it in before production as well.<br /><br />We have made fixes to ensure correct generation order for pl/sql procedures to resolve dependencies, so more pl/sql procedures should compile correctly first time. We made improvement to handle inline DDL statements correctly. Temporary tables, normal tables and other DDL are lifted out of the body of the procedure/function and are created separately.<br /><br />Now for the final bug fix push by the development teams in Dublin and Bangalore. Our QA team, have been doing a good job verifying our fixes and closing off our bugs. The teams have been working hard on this for many months now and I believe we are in touching distance of reaching our goal. It will be very exciting for me personally to see this second generation migration tool reach production. We'll all need some time off when this is done to recharge...<br /><br /><span style="font-weight: bold;"></span>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com4tag:blogger.com,1999:blog-36349144.post-20635525900887612892007-04-04T16:45:00.000+01:002007-04-04T17:18:00.241+01:00Oracle Application Express 3.0 a credible alternative to Microsoft Access?I hope most people know by now that Oracle Application Express (APEX) 3.0 has gone production, is available for download from <a href="http://www.oracle.com/technology/products/database/application_express/index.html">OTN</a> and our hosted instance, <a href="http://apex.oracle.com/i/index.html">apex.oracle.com</a> had also been upgraded to 3.0. There has been some positive reviews in the press recently, here are links to a number of them:<br /><br /><a style="color: blue;" href="http://www.crn.com/software/198700303" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> Oracle Updates Application Express Tool</a><br /><a style="color: blue;" href="http://searchoracle.techtarget.com/originalContent/0,289142,sid41_gci1248831,00.html" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> Oracle updates free Web development tool</a><br /><a href="http://www.infoworld.com/article/07/03/26/HNoracleappexpress_1.html">Oracle has big ambitions for Application Express</a><br /><a href="http://www.networkworld.com/news/2007/032607-oracle-web-apps.html">Oracle improves free tool for building Web Applications</a><br /><a href="http://www.crmbuyer.com/story/JtaeOp3rzlUKYM/Oracle-Application-Express-30-Touts-Access-Migration.xhtml">Oracle Application Express 3.0 Touts Access Migration</a><br /><br /><br />Most customers I talk with have problems with Access and are looking at alternatives, which I guess is the reason I am talking with them in the first place. However, Microsoft Access is a popular desktop database and was updated recently as part of the Office 2007. That said, it is desktop centric and more suited (optimized?) for productivity applications used by individuals or small groups.<br /><br />On our OTN page about the Application Migration Workshop we have published a high level feature comparison of Access and Oracle APEX.<br /><br />Is Oracle Application Express 3.0 a credible alternative to Microsoft Access?<br /><br />What do you think?Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com11tag:blogger.com,1999:blog-36349144.post-63386059203485773902007-03-12T14:11:00.000+00:002007-03-12T17:00:48.226+00:00Oracle SQL Developer Migration Workbench Early Adopter ReleaseLast week we released on OTN the early adopter release of the Oracle SQL Developer Migration Workbench. You can find more details about it <a href="http://www.oracle.com/technology/tech/migration/workbench/index_sqldev_omwb.html">here</a>. It was a very important release for us, and marks the start of a new generation of migration tools.<br /><br />It is nearly 10 years ago when the original Oracle Migration Workbench was released, we supported migrating SQL Server 6.5 to Oracle8 then. At that time, I believe we were the first to introduce a GUI tool. Previously we had provided a series of migration scripts (shell based + SQL) and a stored procedure converter utility. We went on to add support for Access, Sybase, Informix, DB2 utilizing the same user interface by leveraging our plugin architecture. Over the years we have seen our database competitors and others release similar migration tools for their databases.<br /><br />With this release, I believe we have made the same dramatic shift again that we did back in 1998. By integrating our migration tool as a extension of SQL developer (our very popular tool for database developers) we have provided our users with a modern intuitive UI tightly integrated into an IDE, that should make users even more productive as they carry out database migrations. I don't believe any of our competitors have delivered such tight integration.<br /><br />This initial release supports Microsoft SQL Server, Access and MySQL. We are introducing support for migrating Microsoft SQL Server 2005 with this release. These third party databases represents the most popular downloads for our existing Oracle Migration Workbench. We will add further platforms in the future. We have also architected this solution, to make it even easier to extend and leverage the rich core migration functionality that we have developed. We hope that others will also extend this tool going forward adding support for additional databases.<br /><br />The focus now, is on completing some features which missed the cut for the early adopter release, (more on that in a later post) , getting feedback from our user community and fixing as many reported bugs to ensure the highest possible quality release, when we go production, as SQL Developer 1.2. I encourage you to try it out and provide us with feedback. We have setup a comment application which you can provide us with feedback. You can access it <a href="http://apex.oracle.com/pls/otn/f?p=OMWBFDBK">here</a>.<br /><br />Some of my favorite features of this new release includes:<br /><ul><li>Least privilege migration - You no longer need dba privileges</li><li>Online Data Move - We have enhanced the online data move and provide parallel data move and the degree of parallelism is configurable</li><li>New T/SQL parser - We have completing rewritten our T/SQL parser. If I'm honest, it was long over due, but this new parser, provides us with the right foundation for a much greater level of automation in converting complex objects (stored procedures, views, triggers)</li><li>Translation Scratch Editor - allows for the instant translation of Transact SQL or Microsoft Access SQL to PL/SQL or SQL.</li><li>Translation Difference Viewer - a color-coded side-by-side viewer to display semantic similarities between the source and translated code.</li></ul>Looking forward to reviewing the feedback from our user community, getting those missing features completed and getting this new tool to production status as part of SQL Developer 1.2Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com2tag:blogger.com,1999:blog-36349144.post-90740995324540908112007-02-15T20:01:00.000+00:002007-02-15T20:41:38.358+00:00Consolidation is the key driver for Migration from Microsoft Access to Oracle Application ExpressI have just been reviewing the survey results and feedback received from early adopters of the <a href="http://www.oracle.com/technology/products/database/application_express/migrations/mig_index.html">Application Migration Workshop</a> a new feature of Oracle Application Express to assist with migration of Microsoft Access Forms and Reports to Oracle Application Express.<br /><br />Looking at the data, consolidation is the key reason. In fact, it was twice as popular as the next given reasons of company direction and performance.<br /><br />So what does consolidation really mean in this context. It is 1 to 1, i.e. one Access database to a unique schema in Oracle or is it a many to 1, removing duplication and increasing the shared access to a "single source of truth". I think it is a mixture of both.<br /><br />In talking with customers over the last year or so, some customers have told me that they have thousands of access applications and refer to it as their "access problem". Clearly it would be a stretch to think that they have thousands of unique applications, so there must be a lot of duplication and redundant access databases.<br /><br />So how do you define an appropriate access migration strategy. Well I believe firstly, you need more information about your access databases. This is really an assessment phase. In doing an assessment of a large number of access databases, I would split it into two parts:<br /><ol><li>Technical Assessment</li><li>Business Assessment</li></ol>Technical Assessment<br /><br />In the technical assessment phase, you are trying to build up some key data about these access databases. I refer to it as a technical assessment, as hopefully you could have a utility to collect this information. Data to collect would include:<br /><ul><li>Name, Owner, Size</li><li>Date created, Date last modified</li><li>Version</li><li># of Tables, Forms, Reports, Queries, Pages, Modules,</li><li>Links</li><ul><li>links to other mdb files</li><li>linked data e.g. link tables via ODBC to Oracle, SQL Server, ...<br /></li></ul><li>Location (server)<br /></li><li>...</li></ul>Business Assessment (Business Level Discovery)<br /><br />This requires human involvement, and is critical for a subsequent analysis phase. Data points here would include:<br /><br /><ul><li>Business Owner (by department, group)</li><li>Description (purpose)</li><li>Application Type (data entry, reporting, ...)<br /></li><li>Priority (Business Critical to Redundant)</li><li>Action (migrate, ignore, duplicate, remove, ...)</li><li># of users<br /></li></ul>I can see this being the basis for a nice Oracle Application Express Application, that would support the data entry of business level data, and the generation of useful reports and charts. This would then facilitate the next level of analysis and allow you to ask some interesting questions:<br /><ul><li>What is my spread of versions of Microsoft Access?</li><li>How many copies of project.mdb or tasklist.mdb do I have? :-)</li><li>What's my largest / average access database size?</li><li>Which access databases are most heavily used?<br /></li><li>...</li></ul>Now I think that would be a very useful data collection utility and Oracle APEX application.Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com1tag:blogger.com,1999:blog-36349144.post-62008341568909659112006-11-30T23:10:00.000+00:002006-12-11T14:24:11.168+00:00Oracle APEX Application Migration Workshop is now on OTN!While the road to release has not been as smooth as I would have liked (down to me in parts :-) ) , we have finally published the early adopter version on OTN.<br /><br />We very much welcome your feedback on it. Our plans is to have this as a standard feature of Oracle APEX 3.0, so you have the chance of your feedback making a difference in the final product in a short timeframe. I look forward to receving your feedback and making the product better because of it.<br /><br />You will find more details about it <a href="http://www.oracle.com/technology/products/database/application_express/migrations/mig_index.html">here</a>.<br /><br />Enjoy, DonalAnonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0tag:blogger.com,1999:blog-36349144.post-18689218330632695652006-11-29T16:18:00.000+00:002006-11-29T21:53:47.060+00:00Design Goals for the Oracle APEX Application Migration WorkshopWe are in the home stretch now, to make the early adopter version of the Oracle APEX Application Migration Workshop available on OTN. We have released some more information about it on <a href="http://www.oracle.com/technology/products/database/application_express/migrations/mig_index.html">OTN</a> and have created a new <a href="http://forums.oracle.com/forums/forum.jspa?forumID=356">OTN forum</a> to host discussions about migration from Microsoft Access to Oracle Application Express.<br /><br />I thought it would be an opportune time, to outline some of our design goals behind this development. Firstly, we want to promote Database Refactoring, once you have gotten your schema and data migrated using the <a href="http://www.oracle.com/technology/tech/migration/workbench/index.html">Oracle Migration Workbench</a>. The better your Data Model is, the easier it will be to create good Oracle APEX applications. Currently we identify tables without primary or foreign keys and also promote the usage of UI defaults, a feature of Oracle APEX. We hope to expand on this in the future, based on feedback. A possibility could be to identify tables that could be leveraged as List of Values (LOV's) or try to identify incorrect usage of data types, e.g. dates being stored as varchar.<br /><br />Our approach is one of Design Recovery. We want to provide as much information about the original Access Application that we could recover from the Access mdb file. We have taken a workshop approach, to provide the developer a productive environment to decide what Access objects they are interested in and should be in scope. You deal with any errors reported, so additional objects can also be included. By default all Access objects which we analyze and determine are valid are included in the scope your migration project by default.<br /><br />Our goal is to only generate a native Oracle APEX application. We are not interested in emulating unique Access functionality. Access Applications could be classed as "rich client" applications whereas Oracle APEX applications are Web (Browser) based. It's a different UI paradigm, and this needs to be respected if you are to create, intuitive and useful applications. We don't migrate any VBA code, but we will show you the VBA code contained in your modules. You could then determine if this logic is still necessary and if so, could be reimplemented as PL/SQL procedures/functions.<br /><br />We can generate either an application based on selected Access Forms or Reports or generate a maintenance style application which is a Report and a Form on each selected Tables and Views.<br />Our application generation leverages the Application Model behind the create application wizard.<br /><br />I am looking forward to feedback on this new feature of Oracle APEX. I believe we have built a good foundation, to address additional feature requests we might receive. With input from the community we can ensure that the Application Migration Workshop increases the productivity of developers who seek to migrate Access applications to Oracle APEX, when it becomes a standard feature of Oracle APEX 3.0<br /><br />Now back to the last round of testing...<br /><br /><p:colorscheme colors="#FFFFFF,#000000,#777777,#000000,#FD0000,#C0C0C0,#4D4D4D,#667263"> </p:colorscheme>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com6tag:blogger.com,1999:blog-36349144.post-1163104633619287202006-11-09T20:03:00.000+00:002006-11-09T20:53:55.106+00:00Database Tools Talks at UKOUG next weekNext week I'll be in Birmingham at the UK Oracle User Group <a href="http://conference.ukoug.org/">Conference</a>. I am looking forward to it, as it gives me another opportunity to talk about our new tools. This year, I think the database tools team is well represented.<br /><br />Mike Hichwa, VP of Database Tools (main architect behind Oracle Application Express & my boss!) will be giving a presentation on Thursday morning @ 9am titled - <a href="http://conference.ukoug.org/default.asp?p=246&dlgact=searchshwprs&prs_prsid=670&day_dayid=1&src_dayid=1%2C+2%2C+3%2C+4&prs_keywords=hichwa">An Insight into SQL Developer and Application Express</a><br /><br />Sue Harper, PM for SQL Developer is giving a presentation on Wednesday on <a href="http://conference.ukoug.org/default.asp?p=246&dlgact=searchshwprs&prs_prsid=180&day_dayid=1&src_dayid=1%2C+2%2C+3%2C+4&prs_keywords=harper">SQL Developer: Using Oracle's Graphical Database Development Tool</a>. As you probably know by now, we have released an evaluation copy of <a href="http://www.oracle.com/technology/products/database/sql_developer/index.html">SQL Developer 1.1</a> on OTN, so I am sure Sue will cover all the new cool features in 1.1 and answer any questions you might have.<br /><br />Alex Keh, a PM whose focus is on our windows technologies is giving a presentation on Tuesday about <a href="http://conference.ukoug.org/default.asp?p=246&dlgact=searchshwprs&prs_prsid=599&day_dayid=1&src_dayid=1%2C+2%2C+3%2C+4&prs_keywords=keh">.NET and Oracle Best Practices: Performance, Deployment and PL/SQL Tips</a><span style="font-style: italic;">. </span>So if your preferred development environment is .NET be sure to attend his talk. I think we do a lot to make a .NET developers experience productive with Oracle database technology.<br /><br />For myself, lucky me has 3 presentations!<br /><br />On Tuesday I will be talking about: <a href="http://conference.ukoug.org/default.asp?p=246&dlgact=searchshwprs&prs_prsid=451&day_dayid=1&src_dayid=1%2C+2%2C+3%2C+4&prs_keywords=daly">End the Microsoft Access Chaos - Your simplified path to Oracle Application Express</a>. I will be demoing our new Oracle APEX Application Migration Workshop. This should also be making an appearance on OTN real soon...<br /><br />Then on Thursday, I have two presentations: <a href="http://conference.ukoug.org/default.asp?p=246&dlgact=searchshwprs&prs_prsid=181&day_dayid=1&src_dayid=1%2C+2%2C+3%2C+4&prs_keywords=daly">Oracle Application Express: Features, Futures and Customer Tales</a> In this presentation, I give a brief overview of Application Express, What's in 2.2, what's coming in 3.0 and some demos and finally <a href="http://conference.ukoug.org/default.asp?p=246&dlgact=searchshwprs&prs_prsid=452&day_dayid=1&src_dayid=1%2C+2%2C+3%2C+4&prs_keywords=daly">Oracle Migration Workbench: Taking Database migration to the next level</a> where I will demo the new Oracle Migration Workbench integrated into SQL Developer. This should be making an appearance on OTN in 2007.<br /><br />I am also looking forward to hearing customer feedback at the Oracle Development Tools Roundtable on Wednesday afternoon.<br /><br />Having had a look at the agenda there are many talks which I want to attend. Looks like it is going to be a good week. Now to put the finishing touches to my presentations...Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com0tag:blogger.com,1999:blog-36349144.post-1162679285337763542006-11-04T22:22:00.000+00:002006-11-05T09:42:17.693+00:00I won't get much work done this weekend....Not a work related post, but...<br /><br />I was asked by the Porsche club of Ireland (of which I am a member) would I be willing to write a car review for their newsletter as the Irish Porsche dealership offered them a car for the weekend. I could pick what I wanted, so I went for a 997 C4S manual.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://photos1.blogger.com/blogger/2695/4061/1600/c4s.jpg"><img style="margin: 0px auto 10px; display: block; text-align: center; cursor: pointer;" src="http://photos1.blogger.com/blogger/2695/4061/320/c4s.jpg" alt="" border="0" /></a><br /><br />In the picture is my son Daragh, and Alan from the Porsche dealership. In Ireland cars have high taxes , so this car costs €160K/$203K.... The car is on my insurance, so I have to be careful <span class="moz-smiley-s1">:-) </span><br /><br />I had promised Julie I would sort out the garden this weekend and deal with all the leaves, sorry not this weekend!<br /><br /><br /></span>Anonymoushttp://www.blogger.com/profile/10733509547372080487noreply@blogger.com1