SQL DBA to Big Data

  • We hear a lot about BigData and i am confused how does it help SQL DBA's. I am a SQL DBA and would be interested to understand and learn the new data technologies which helps me in my career. I understand that Hadoop is an open source and most of its tools are written in Java. As an ardent fan of Microsoft Technologies i would like to know where do i start on this and if the good to stay as SQL DBA or transition to BigData analytics.

    All your insights and suggestions are deeply appreciated.

    Thanks,

  • For unstructured or semi-structured data within the Microsoft sphere, you're looking at HDInsight[/url], they're version of Hadoop, or DocumentDB[/url]. If you want to stay within the Microsoft stack, and I don't blame you, it's where I work, then those would be the ones I would suggest.

    Just remember, these are specialized data management processes. They don't replace the need for traditional structured storage, even though lots of people say they do.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • Thanks for that detail.

    How much sense does to make to move from SQL DBA role to BigData becuase in my current role i work more at the infra level and somewhat at the data level. I am kind of confused how to shape my career progression.

  • Hard to say. I've driven my career by interest and opportunity. What am I interested in and what do I have the opportunities to do. So far, that's by and large driven me further and further into the guts of SQL Server and the query engine. However, I keep an eye out and observe the other stuff as it comes along. I'm pretty excited about DocumentDB, but I haven't seen much in the way of job opportunities there, so far.

    I'd say keep your options open and observe stuff as it comes by. Even with all these new technologies available, there are going to be solid, well-paying jobs for structured data specialists for at least the next 10-15 years.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • However, I keep an eye out and observe the other stuff as it comes along. I'm pretty excited about DocumentDB...

    I'd be excited about DocumentDB if I could run it locally instead of on Azure. But then it wouldn't be "Big Data"...

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply