码迷,mamicode.com
首页 > 其他好文 > 详细

What is the difference between Full load and Incremental load

时间:2015-07-07 17:09:26      阅读:161      评论:0      收藏:0      [点我收藏+]

标签:obia   etl   full load   incremental load   

In most OBIA projects we create both incremental and full load mappings for each tables in Date Warehouse target. Below you can find the difference between both.

Full Load is the entire data dump load taking place the very first time. In this we give the last extract date as empty so that all the data gets loaded

Incremental - Where difference between target and source data is dumped at regular intervals.Here we give the last extract date such that only records after this date are loaded.

Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
  • Full load: $$Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded
  • Incremental load:$$Last_Extract_Date = The date from which you need the data (to get latest record).
- See more at: http://dwhlaureate.blogspot.jp/2012/06/what-is-full-load-incremental-load-full.html#sthash.Sn5gFBNo.dpuf
Note:
Full Load: Last_Extract_Date = either leave it blank or give some old date so that all the records are loaded.
Incremental Load: Last_Extract_Date = The date from which you need the data (to get latest record).

Why Incremental:
  • Speed.
  • Preserving history

  • Full Load vs Incremental Load:


    Full Load
    Incremental Load
    Truncates all rows and loads from scratch.
    New records and updated ones are loaded
    Requires more time.
    Requires less time.
    Can easily be guaranteed
    Difficult. ETL must check for new/updated rows.
    Can be lost.
    Retained.

    版权声明:本文为博主原创文章,未经博主允许不得转载。

    What is the difference between Full load and Incremental load

    标签:obia   etl   full load   incremental load   

    原文地址:http://blog.csdn.net/seaee/article/details/46789257

    (0)
    (0)
       
    举报
    评论 一句话评论(0
    登录后才能评论!
    © 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
    迷上了代码!