Not logged in [Login - Register]
 Sciencemadness Discussion Board » Non-chemistry » Forum Matters » Site Backup Select A Forum Fundamentals   » Chemistry in General   » Organic Chemistry   » Reagents and Apparatus Acquisition   » Beginnings   » Miscellaneous   » The Wiki Special topics   » Technochemistry   » Energetic Materials   » Biochemistry   » Radiochemistry   » Computational Models and Techniques   » Prepublication   » References Non-chemistry   » Forum Matters   » Legal and Societal Issues   » Whimsy   » Detritus   » The Moderators' Lounge

Pages:  1  2    4
Author: Subject: Site Backup
woelen

Posts: 5953
Registered: 20-8-2005
Location: Netherlands
Member Is Offline

Mood: interested

I revived the website, including the scipics and the protected forums on a dedicated server, with Ubuntu, Apache, PHP and MySQL installed and I have had it all running and tested by Polverone through the internet on my own domain. After Polverone's successful testing I brought it down again. So, the instructions of Polverone are perfectly suitable to revive the website on a new domain and new hardware if that ever may become necessary.

The art of wondering makes life worth living...
Want to wonder? Look at http://www.oelen.net/science
TheOrbit
Hazard to Self

Posts: 59
Registered: 4-4-2009
Location: deepth point of a black hole
Member Is Offline

Mood: manic bipolar science dis/order

i downloaded zip file several times but it keep giving an error

 Quote: sm_offline.zip: The archive is either in unknown format or damaged

even when i check to leave broken files it doesn't work ???

Polverone
Now celebrating 14 years of madness

Posts: 3120
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline

Quote: Originally posted by TheOrbit
i downloaded zip file several times but it keep giving an error

 Quote: sm_offline.zip: The archive is either in unknown format or damaged

even when i check to leave broken files it doesn't work ???

The archive should be 3728725636 bytes in size and have the MD5 hash 50afa10d0373b020f2f0a44b8480d722. If your copy does not match those parameters, it has not been downloaded correctly. If it does match those parameters, I suspect something wrong with your computer (bad RAM or bad archival program). The archive has been successfully downloaded and unpacked before.

Remember to use a client with support for resuming downloads. The host the file is on is inexpensive, but touchy with very large files. You will almost certainly get an incomplete archive if you just use the stock download option in IE or Firefox.

PGP Key and corresponding e-mail address
woelen

Posts: 5953
Registered: 20-8-2005
Location: Netherlands
Member Is Offline

Mood: interested

Use the program http://users.ugent.be/~bpuype/wget/ for downloading this file. This has worked for me very well. Just start it in a shell (or DOS box if you are on Windows) and leave the computer running for a few hours.

The art of wondering makes life worth living...
Want to wonder? Look at http://www.oelen.net/science
dann2
International Hazard

Posts: 1523
Registered: 31-1-2007
Member Is Offline

Use the -c switch
eg: (at command prompt)...> wget -c http://XXXXXXXXXXXX
TheOrbit
Hazard to Self

Posts: 59
Registered: 4-4-2009
Location: deepth point of a black hole
Member Is Offline

Mood: manic bipolar science dis/order

thanks for help, i was able to extract it on my mini rather than the desktop i used first " that is weird as the desktop is of higher features", thanks .
dann2
International Hazard

Posts: 1523
Registered: 31-1-2007
Member Is Offline

Hello,
Can you run the offline version of SCI.MADNESS.ORG with your internet connection disconnected (pull the actual wire out of the back (or side) of your computer).
My 'offline' version works OK but when I pull the internet connection from my computer it ceases to function. Not very off line!

Dann2
woelen

Posts: 5953
Registered: 20-8-2005
Location: Netherlands
Member Is Offline

Mood: interested

Yes, you can have the offline version running, but then your system needs a working local host. I know of some computer systems, which have no working TCP/IP stack when there is no physical network interface on the system. Other computer systems always have a loopback device with IP-address 127.0.0.1 which always is there, even if no physical network interface is present. Check whether you can connect to 127.0.0.1 (or localhost).

The art of wondering makes life worth living...
Want to wonder? Look at http://www.oelen.net/science
TheOrbit
Hazard to Self

Posts: 59
Registered: 4-4-2009
Location: deepth point of a black hole
Member Is Offline

Mood: manic bipolar science dis/order

sorry, i have another question. i export the database of the forum " about 500 MB" from phpmyadmin then i tried to import it in my local xmb forum " using both bigdump and mysqldumper" but it restore single 1st table "attachments" , and keep give errors f mysql.
is there is any way to import this big file into local forum ????
Polverone
Now celebrating 14 years of madness

Posts: 3120
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline

 Quote: Originally posted by dann2 Hello, Can you run the offline version of SCI.MADNESS.ORG with your internet connection disconnected (pull the actual wire out of the back (or side) of your computer). My 'offline' version works OK but when I pull the internet connection from my computer it ceases to function. Not very off line! Dann2

I understand that this problem comes up when DHCP is not available for the virtual machine to obtain a network address from. It's DHCP service from your router that is important, rather than a live internet connection: unplug the external internet connection from your router and the backup will still work fine. Last year I tried a couple of experiments to get a DHCP service running on a completely unplugged machine, just for host-guest communication, but was unsuccessful. Until someone who knows networks better can advise, I don't know how to solve it.

PGP Key and corresponding e-mail address
Polverone
Now celebrating 14 years of madness

Posts: 3120
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline

 Quote: Originally posted by TheOrbit sorry, i have another question. i export the database of the forum " about 500 MB" from phpmyadmin then i tried to import it in my local xmb forum " using both bigdump and mysqldumper" but it restore single 1st table "attachments" , and keep give errors f mysql. is there is any way to import this big file into local forum ????

If you use mysqldump/mysql from the command line it should work fine. I know that I have had problems using graphical, web-based dump/restore tools with the forum before. The forum with attachments included is much larger than 500 megabytes. I had to stop using phpmyadmin for export years ago because it seemed to stop working as the database got large.

[Edited on 1-12-2011 by Polverone]

PGP Key and corresponding e-mail address
Harmless

Posts: 39
Registered: 14-9-2010
Member Is Offline

Complete Sciencemadness backup hosted on a 1 gbit line.

------------------------------------------------------------------------------

contents:
1.1G library.zip
3.3G los.alamos.technical.reports.zip
1.7M member.publications.zip
89M scipics.zip
3.5G sm_offline.zip

Notes:
The forum backup itself is the same as from this thread. This torrent also includes the content from the rest of the site.

------------------------------------------------------------------------------

Harmless

Posts: 39
Registered: 14-9-2010
Member Is Offline

The very same data as the last torrent.

Only the torrent name is spelled correctly, typo free

Polverone
Now celebrating 14 years of madness

Posts: 3120
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline

backup updated

I have updated the forum backup.

The new backup is 4065379728 bytes and has MD5 sum 390171a5f7eb650d7ca8bd18e688cbd3.

Background and instructions for use are in my previous "sciencemadness contingency plan" post.

PGP Key and corresponding e-mail address
AndersHoveland
Hazard to Other Members, due to repeated speculation and posting of untested highly dangerous procedures!

Posts: 1986
Registered: 2-3-2011
Member Is Offline

I think a archived backup for science madness is very important. This forum contains some of the best chemistry information for amateur experimenters available. This forum will not last forever, and it would be very unfortunate if the information contained within became lost and unavailable to online readers ten years from now.

Many people now lament everything that was lost in the Explosives and Weapons Forum, and even The Hive.
The few records left of the posts made in those forums are now much-sought after by many online readers. I think there should be at least five people that should save full records from this forum, and then come back 5-10 years from now to reintroduce these records back to the online world.

That being said, I think some effort should be done to weed out all the unimportant topics when saving back up records.
This could substantially reduce the file size, making downloads much faster. It would also save future readers from having to sift through so much trash.

Also the search function for this forum is horrible. Even doing a google search, "sodium hydrazide science madness" failed to find the post I made about this unusual compound, although typing "science madness NaN2H3" does find it. Hopefully it will be easier for future readers to search for what they are looking for in the forum records.

Also, when you include a link, please make a quick summary of what important information you found in the link. Many of the links in older posts no longer work. If you take pictures, it would may be helpful to write a short description of what is in the picture, as picture files may not make their way into all versions of archived forum records.

[Edited on 23-5-2011 by AndersHoveland]
Eliteforum
International Hazard

Posts: 567
Registered: 18-11-2002
Location: United Kingdom
Member Is Offline

Mood: Enjoying the journey

Is the offline backup download speed limited? I'm on a 50mb/s pipe and I'm getting roughly 50 to 80kbps. It's going to take at least 10 hours to download at the current speeds.

Edit -

Currently trying to grab it, but it's taking it's sweet ass time

 Quote: >wget http://library.sciencemadness.org/archive/sm_offline.zip SYSTEM_WGETRC = /wget/etc/wgetrc syswgetrc = /wgetrc --2011-06-20 12:17:43-- http://library.sciencemadness.org/archive/sm_offline.zip Resolving library.sciencemadness.org... 67.23.244.212 Connecting to library.sciencemadness.org|67.23.244.212|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 4065379728 (3.8G) [application/zip] Saving to: sm_offline.zip' 7% [==> ] 320,536,929 71.4K/s in 60m 53s 2011-06-20 13:18:37 (85.7 KB/s) - Connection closed at byte 320536929. Retrying. --2011-06-20 13:18:38-- (try: 2) http://library.sciencemadness.org/archive/sm_ offline.zip Connecting to library.sciencemadness.org|67.23.244.212|:80... connected. HTTP request sent, awaiting response... 206 Partial Content Length: 4065379728 (3.8G), 3744842799 (3.5G) remaining [application/zip] Saving to: sm_offline.zip' 15% [+++==> ] 648,598,594 77.3K/s eta 7h 41m

[Edited on 20-6-2011 by Eliteforum]

[Edited on 20-6-2011 by Eliteforum]

All that glitters isn't gold.
Polverone
Now celebrating 14 years of madness

Posts: 3120
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline

It's not deliberately speed limited, but it is sitting on a cheap host. They don't meter bandwidth use but that also means they have little incentive to provide more bandwidth.

PGP Key and corresponding e-mail address
Eliteforum
International Hazard

Posts: 567
Registered: 18-11-2002
Location: United Kingdom
Member Is Offline

Mood: Enjoying the journey

No worries, I'll get there in the end!

All that glitters isn't gold.
Eliteforum
International Hazard

Posts: 567
Registered: 18-11-2002
Location: United Kingdom
Member Is Offline

Mood: Enjoying the journey

Finally got it.

http://www.criminally-inclined.com/viewtopic.php?f=12&t=58

All that glitters isn't gold.
KemiRockarFett
Hazard to Self

Posts: 84
Registered: 23-7-2004
Member Is Offline

Perfekt I am taking it down right at the moment.
As Anders Hoveland wrote. Its importat to get backups.
Big brother regulates everything right now because of the so called terrorist. Probably its just a question of time until information at forums will be canceled by the big fat big brorhter EUSSR government.
AndersHoveland
Hazard to Other Members, due to repeated speculation and posting of untested highly dangerous procedures!

Posts: 1986
Registered: 2-3-2011
Member Is Offline

When was the last time a file back-up of this forum was made?

Does an archive of Science Madness exist, in the event that this forum was permanently shut down? If so, does this archive also contain all the picture files and images? Some of the threads will be difficult to understand without the molecular diagrams shown in the images.

We can look at what remains from the E+W forum. While there are a few archives from that forum still floating around, they are difficult to find, and it appears that much of the information was lost. Science Madness should prepare now for the future.

I would hate to see half the posts in this forum lost ten years from now.

Polverone
Now celebrating 14 years of madness

Posts: 3120
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline

backup updated

I have updated the forum backup.

The new backup is 4566234886 bytes and has MD5 sum 178b6e9d360381b87e8398ef09c1d6d1.

Background and instructions for use are in my previous "sciencemadness contingency plan" post.

PGP Key and corresponding e-mail address
Polverone
Now celebrating 14 years of madness

Posts: 3120
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline

backup updated

I used the forum downtime on January 18 to prepare a new backup.

The new backup is 4791775448 bytes and has MD5 sum 82e30e3b537118aaa285fe094c459f7b.

Background and instructions for use are in my previous "sciencemadness contingency plan" post.

PGP Key and corresponding e-mail address
Aqua_Fortis_100%
National Hazard

Posts: 301
Registered: 24-12-2006
Location: Brazil
Member Is Offline

Mood:

 Quote: Originally posted by AndersHoveland We can look at what remains from the E+W forum. While there are a few archives from that forum still floating around, they are difficult to find, and it appears that much of the information was lost. Science Madness should prepare now for the future. I would hate to see half the posts in this forum lost ten years from now.

Yeah, it was difficult to find a decent torrent archive and yet was very frustrating compared with the good/old E&W board. The domain roguesci . org is basically a live museum now, dead.

Many thanks to people here and adm himself (Polverone) initiatives to have an active backup on SMDB.

Now with pigs trying to pass this SOPA/PIPA threat, means of legitimate forum defense and the continuity of science discussion are (more than before) vital. Backup is one of these ways.

This is my favourite forum and it cant be vanished in anyway. NEVER!

Long life to SMDB!

"The secret of freedom lies in educating people, whereas the secret of tyranny is in keeping them ignorant."
Eliteforum
International Hazard

Posts: 567
Registered: 18-11-2002
Location: United Kingdom
Member Is Offline

Mood: Enjoying the journey