Home All Groups Group Topic Archive Search About

BCP import large text file to sql tables

Author
20 Nov 2007 4:03 PM
mecn
hi,

I have a huge text file(about 10 GB) that needed to imported to SQL server2k
table.
I know BCP is the fastest way to do it. But if I use BPC, my log shipping to
a prod standby serve will not have BPC transactions.

What should I do to have fast importing process and log shipping synched as
well.

Thanks

Author
20 Nov 2007 4:13 PM
TheSQLGuru
How big is the entire db?  If it is small compared to 10GB I would just
disable log shipping, import, index as appropriate then backup and restore
full db and restart log shipping.  If the db size is very large compared to
10GB you will be better off letting log shipping do it's thing.  If you bcp
with FULL recovery mode and use small batch sizes won't log shipping work
fine?

--
Kevin G. Boles
TheSQLGuru
Indicium Resources, Inc.


Show quote
"mecn" <mecn2***@yahoo.com> wrote in message
news:e67Yi74KIHA.2268@TK2MSFTNGP02.phx.gbl...
> hi,
>
> I have a huge text file(about 10 GB) that needed to imported to SQL
> server2k
> table.
> I know BCP is the fastest way to do it. But if I use BPC, my log shipping
> to
> a prod standby serve will not have BPC transactions.
>
> What should I do to have fast importing process and log shipping synched
> as
> well.
>
> Thanks
>
>
Author
20 Nov 2007 5:13 PM
mecn
the size of Is it related to importing process? The db is 250gb



Show quote
"TheSQLGuru" <kgbo***@earthlink.net> wrote in message
news:13k61tbvko3h51@corp.supernews.com...
> How big is the entire db?  If it is small compared to 10GB I would just
> disable log shipping, import, index as appropriate then backup and restore
> full db and restart log shipping.  If the db size is very large compared
> to 10GB you will be better off letting log shipping do it's thing.  If you
> bcp with FULL recovery mode and use small batch sizes won't log shipping
> work fine?
>
> --
> Kevin G. Boles
> TheSQLGuru
> Indicium Resources, Inc.
>
>
> "mecn" <mecn2***@yahoo.com> wrote in message
> news:e67Yi74KIHA.2268@TK2MSFTNGP02.phx.gbl...
>> hi,
>>
>> I have a huge text file(about 10 GB) that needed to imported to SQL
>> server2k
>> table.
>> I know BCP is the fastest way to do it. But if I use BPC, my log shipping
>> to
>> a prod standby serve will not have BPC transactions.
>>
>> What should I do to have fast importing process and log shipping synched
>> as
>> well.
>>
>> Thanks
>>
>>
>
>
Author
20 Nov 2007 5:33 PM
TheSQLGuru
That is pretty big in relation to the 10GB to be loaded.  I would consider
keeping log shipping online to avoid the 'downtime' required to completely
resync the database after the load.  YMMV.

--
Kevin G. Boles
TheSQLGuru
Indicium Resources, Inc.


Show quote
"mecn" <mecn2***@yahoo.com> wrote in message
news:e95zUi5KIHA.5328@TK2MSFTNGP05.phx.gbl...
> the size of Is it related to importing process? The db is 250gb
>
>
>
> "TheSQLGuru" <kgbo***@earthlink.net> wrote in message
> news:13k61tbvko3h51@corp.supernews.com...
>> How big is the entire db?  If it is small compared to 10GB I would just
>> disable log shipping, import, index as appropriate then backup and
>> restore full db and restart log shipping.  If the db size is very large
>> compared to 10GB you will be better off letting log shipping do it's
>> thing.  If you bcp with FULL recovery mode and use small batch sizes
>> won't log shipping work fine?
>>
>> --
>> Kevin G. Boles
>> TheSQLGuru
>> Indicium Resources, Inc.
>>
>>
>> "mecn" <mecn2***@yahoo.com> wrote in message
>> news:e67Yi74KIHA.2268@TK2MSFTNGP02.phx.gbl...
>>> hi,
>>>
>>> I have a huge text file(about 10 GB) that needed to imported to SQL
>>> server2k
>>> table.
>>> I know BCP is the fastest way to do it. But if I use BPC, my log
>>> shipping to
>>> a prod standby serve will not have BPC transactions.
>>>
>>> What should I do to have fast importing process and log shipping synched
>>> as
>>> well.
>>>
>>> Thanks
>>>
>>>
>>
>>
>
>
Author
20 Nov 2007 6:18 PM
mecn
I have weekly large import --- 20GB text file(35 million records) need to
insert into 2 tables _ i need performance as well.
What is the best way to acomplish this with fullly log shipping synched.

Thanks


Show quote
"TheSQLGuru" <kgbo***@earthlink.net> wrote in message
news:13k66ifi8esog81@corp.supernews.com...
> That is pretty big in relation to the 10GB to be loaded.  I would consider
> keeping log shipping online to avoid the 'downtime' required to completely
> resync the database after the load.  YMMV.
>
> --
> Kevin G. Boles
> TheSQLGuru
> Indicium Resources, Inc.
>
>
> "mecn" <mecn2***@yahoo.com> wrote in message
> news:e95zUi5KIHA.5328@TK2MSFTNGP05.phx.gbl...
>> the size of Is it related to importing process? The db is 250gb
>>
>>
>>
>> "TheSQLGuru" <kgbo***@earthlink.net> wrote in message
>> news:13k61tbvko3h51@corp.supernews.com...
>>> How big is the entire db?  If it is small compared to 10GB I would just
>>> disable log shipping, import, index as appropriate then backup and
>>> restore full db and restart log shipping.  If the db size is very large
>>> compared to 10GB you will be better off letting log shipping do it's
>>> thing.  If you bcp with FULL recovery mode and use small batch sizes
>>> won't log shipping work fine?
>>>
>>> --
>>> Kevin G. Boles
>>> TheSQLGuru
>>> Indicium Resources, Inc.
>>>
>>>
>>> "mecn" <mecn2***@yahoo.com> wrote in message
>>> news:e67Yi74KIHA.2268@TK2MSFTNGP02.phx.gbl...
>>>> hi,
>>>>
>>>> I have a huge text file(about 10 GB) that needed to imported to SQL
>>>> server2k
>>>> table.
>>>> I know BCP is the fastest way to do it. But if I use BPC, my log
>>>> shipping to
>>>> a prod standby serve will not have BPC transactions.
>>>>
>>>> What should I do to have fast importing process and log shipping
>>>> synched as
>>>> well.
>>>>
>>>> Thanks
>>>>
>>>>
>>>
>>>
>>
>>
>
>

AddThis Social Bookmark Button