.NETGURU
  Search:  
NamespacesDiscussions.NET v1.1Dot Net Guru's BlogIT Certification
How big can XML file be?
Messages   Related Types
This message was discovered on microsoft.public.dotnet.languages.csharp.
Responses highlighted in red are from those people who are likely to be able to contribute good, authoratitive information to this discussion. They include Microsoft employees, MVP's and others who IMHO contribute well to these kinds of discussions.
Post a new message to this list...

kids_pro
Hi there,

I have a quick question. I want to store all my data in XML file so that I
don't need to depend on database backend. But I wonder how big can my XML
file be?

I don't mind to span the data into multiple file but I less I know the
limitation first.

Cheers,
Kids
Reply to this message...
 
    
Peter Rilling
Well, the XML engine might have some inherit limit as far as the number of
child nodes for instance. After all, if Count is an int, then at least you
cannot exceed that max value.

More interesting concerns might be the memory usage and the processing time.
The memory footprint for XML (if loaded in a DOM) is probably exponential.
Also, the time required to access a node is also great if using an XPath.

For small requirements, it might not be a big problem, but these are also
issues you need to consider when using XML rather then RDBMS.

Although, I do not know exact numbers to answer your questions.

"kids_pro" <Click here to reveal e-mail address> wrote in message
news:%Click here to reveal e-mail address...
[Original message clipped]
Reply to this message...
 
    
Greg (VIP)
I had read somewhere that an XML file can go upto a
Gigabyte..

Is this true

[Original message clipped]
Reply to this message...
 
    
Dennis Myrén
Using a DOM approach the limit would logically be the
amount of RAM available.
Therefore, a gigabyte XML document is not very likely
to be able to be parsed using DOM.
However, using a SAX approach or System.Xml.XmlReader,
it would, at least in theory, be possible.

--
Regards,
Dennis JD Myrén
Oslo Kodebureau
"Greg" <Click here to reveal e-mail address> wrote in message
news:082c01c4965b$39b52660$Click here to reveal e-mail address...
[Original message clipped]
Reply to this message...
 
    
Russ Gray
Dennis Myrén wrote:

[Original message clipped]

It's certainly possible with an XmlTextReader - I've processed xml files
well in excess of a gigabyte (on occasion closer to 3 GB) whilst testing
the large-file capabilities of some inhouse software. I wouldn't want to
try it with an XmlDocument or DataSet though.

--
Remove SHOES to reply.
Reply to this message...
 
    
Kim Schulz
On Thu, 9 Sep 2004 08:09:40 +0700
"kids_pro" <Click here to reveal e-mail address> wrote:

[Original message clipped]

we have xml files with map data that has sizes above 1gb each.

takes time to parse, but they work

--
Kim Schulz | Need a Content Management System for your website? Go
Geek by nature | get Fundanemt at : http://www.fundanemt.com New
schulz.dk | version out now!
Reply to this message...
 
    
kids_pro
Is it okay to query large XML file?
What is the best practise?

"Kim Schulz" <Click here to reveal e-mail address> wrote in message
news:Click here to reveal e-mail address...
[Original message clipped]
Reply to this message...
 
    
Richard Blewett [DevelopMentor] (VIP)
If you are going to process a large XML file you should use XmlTextReader (as opposed to XmlDocument or XPathDocument) as XmlTextReader doesn?t parse the document into a DOM tree.

The only drawback is your code is more complex as you are writing to a lower level interface rather than using XPath.

Regards

Richard Blewett ? DevelopMentor
http://staff.develop.com/richardb/weblog
?
nntp://news.microsoft.com/microsoft.public.dotnet.languages.csharp/
Is it okay to query large XML file?
What is the best practise?

"Kim Schulz" wrote in message news:Click here to reveal e-mail address...
[Original message clipped]

---
Incoming mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.760 / Virus Database: 509 - Release Date: 10/09/2004

[microsoft.public.dotnet.languages.csharp]
Reply to this message...
 
    
clintonG
Really Really Really Big.
I've read news items where they were discussing the best
methodology to manage a 52Mb file.

--
<%= Clinton Gallagher, "Twice the Results -- Half the Cost"
Architectural & e-Business Consulting -- Software Development
NET Click here to reveal e-mail address
URL http://www.metromilwaukee.com/clintongallagher/

"kids_pro" <Click here to reveal e-mail address> wrote in message
news:%Click here to reveal e-mail address...
[Original message clipped]
Reply to this message...
 
    
kids_pro
52 MB ? Wow that is more than enough for my problem.
My estimate size if about half of this.

I only have less than 4 level nodes.
So you think XPath can live with this requierment?

I reason I go to XML rather RDBMS (like Ms. Access or SQL)
cuz it doesn't support our unicode set 1780-17FF I can't make query using
these RDBMS.

Cheers,
Kids

"clintonG" <Click here to reveal e-mail address> wrote in message
news:Click here to reveal e-mail address...
[Original message clipped]
Reply to this message...
 
    
Ignacio Machin \( .NET/ C# MVP \)
Hi,

It depends of your platform, memory availability, etc

I have a 13-15 MB xml file and it works just fine.
Please note that this is only intended for datastorage, In memory it's a
dataset.

cheers,

--
Ignacio Machin,
ignacio.machin AT dot.state.fl.us
Florida Department Of Transportation

"kids_pro" <Click here to reveal e-mail address> wrote in message
news:%Click here to reveal e-mail address...
[Original message clipped]
Reply to this message...
 
 
System.Data.DataSet
System.Xml.XmlDocument
System.Xml.XmlReader
System.Xml.XmlTextReader
System.Xml.XPath.XPathDocument




ExamGuru IT Solutions - .Net Guru is owned and operated by ExamGuru, Inc., the man behind .Net Guru. If you're in the market for bespoke software or software consultancy, why not get him and his highly trained team to help? - www.examguru.net/ITCertification
Ad


Need Dot Net Interview Questions?
Ask ExamGuru, Inc. for advice and help on Passing .Net Interviews
.Net Projects
Best-of-breed application framework for .NET projects, developed by ExamGuru, Inc. and ExamGuru IT
Free .net Help
Commission ExamGuru, Inc. and his team for your next bespoke software project
FogBUGZ
The only bug tracking system carefully crafted with one goal in mind: helping teams create great software.
Awesome Tools
If you don't know about these, you're missing out... IT Certification Questions
IT Interview Questions
Free Oracle 10g Training
MCSE Boortcamp
Cisco Study Guides
Cheap Study Guides
Exact Questions
Dot Net Interview Questions
Oracle OCP
Cheap Travel
Designer Perfumes - Wholesale Prices
Free Programming Tutorials
 
ExamGuru IT Solutions - .Net Guru is owned and operated by ExamGuru, Inc., the man behind .Net Guru. If you're in the market for bespoke software or software consultancy, why not get him and his highly trained team to help? - www.examguru.net/ITCertification
 Copyright © ExamGuru, Inc. 2001-2006
Contact Us - Terms of Use - Privacy Policy - www.dot-net-guru.com - www.examguru.net - www.oraclesource.net - www.itinterviews.net - www.examguru.net/ITCertification