Since my last article about my LAMP neural networking project, Simms, I've made some substantial progress on both the algorithmic basis for the project and the underlying stability of the machines and thread handling that maintains its functionality. First and foremost, I've added two more subprocessing cores, Simms4 and Simms5. Simms4 is a dual-processor server with 2GB of RAM and dual SCSI hard drives; it has previously served several incarnations as 'Renderer' and 'Cemetech1'. I will be putting Simms4 to work performing backup duties for the Simms' cluster's brain (ie MySQL database) and producing daily renders of the full brain architecture. The second machine, Simms5, has identical specs to the existing Simms0, Simms1, Simms2, and Simms3 machines, namely a 1.4GHz P4, 1GB of RAM, and a 40GB hard drive. I have no specific job for it yet, but will put it to work sharing the load from the existing subcores.

On the physical side, I added scripting to automatically synchronize files from the supervisor machine, Simms, to each of the six subcores, and improved the thread handling to decrease the occurrence of race conditions causing duplicate threads to be spawned. On the software side, I added some minor optimizations to the core brain logic module and fixed a few bugs in the aim and secretary modules.

In order to repair some design flaws in the original Simms logic processing database (currently known as the LTM) I am forking what is now known Simms1 into a separate Simms2, which will be tested and brought live over the next few days. I'll post updates when it's live and functional. Among other things, this should vastly improve processing speed, decrease MySQL CPU load on the supervisor, and improve Simms' response time and conversational speed.

Update: Database update still running. The old table had 1,784,271 rows at 229 bytes per row = 399,165 KB. The new table so far has 12,040,307 rows at 29 bytes per row = 343,422 KB. I anticipate it being much smaller once I remove all the rows that seem to have null topics.
nice work Very Happy I think you should diagram this in the GIMP Wink
elfprince13 wrote:
nice work Very Happy I think you should diagram this in the GIMP Wink
Fear not, I have two separate visualization tools in the works for this. Very Happy
I meant diagram the exchange of data + workload between Simms[0,5]
elfprince13 wrote:
I meant diagram the exchange of data + workload between Simms[0,5]
Yup. I meant that too. Except make it a realtime AJAXy-type thing that dynamically displays the ebb and flow of workload. Smile

As far as the upgrade goes, I just restarted it because I found a bunch more optimizations to perform. 12,000 rows of 1,780,000 converted so far.
*bump* 851,709 of the 1,784,271 converted. This is taking forever. Razz
lol, obviously your wikipedia-reader has been hard at work
elfprince13 wrote:
0x5, obviously your wikipedia-reader has been hard at work
Indeed. 858,758K. :/
KermMartian wrote:
elfprince13 wrote:
0x5, obviously your wikipedia-reader has been hard at work
Indeed. 858,758K. :/
'Twas at 909K, but unfortunately one of my classmates "accidentally" reset the Simms core, so I dunno if the database is intact. I'm going to boot it in a few minutes and see what's what.
  
Register to Join the Conversation
Have your own thoughts to add to this or any other topic? Want to ask a question, offer a suggestion, share your own programs and projects, upload a file to the file archives, get help with calculator and computer programming, or simply chat with like-minded coders and tech and calculator enthusiasts via the site-wide AJAX SAX widget? Registration for a free Cemetech account only takes a minute.

» Go to Registration page
Page 1 of 1
» All times are UTC - 5 Hours
 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum

 

Advertisement