good luck man, i did not want to move away from 1.9.2, we know why ;)....but i bought a few 62's so i had to

build all my overviews, had almost 400 corrupted vidz & 50 corrupted audio tracks....all these were fine in 1.9.2 :(

another thing, the tags are gone from some of my vidz no name artist etc. & the overview will not save for those vidz :(.....again all these were fine in 1.9.2

that said i removed all corrupted files & all is working well no issues at all running smooth, good luck!

Let me know when you're done
Still on 2.2 and won't budge until I'm forced

OK, So heres an update:

**finished re-doing over 16,000 songs.
out of that huge mess of music I ended up with only 5 corrupt files total.
4 of which where from the same editor.
So, not too shabby right?
I have alot of re-writting to do in the name & artists department though.

**
Today the REAL test begins.
Re-annylizing my video files.
Right off the bat I dropped in 750 tracks, and about 50 popped up corrupt.
no rhyme or reason cept in this case so far they certainly seemed to be older videos.
(nothing i got in the last year or so)
but they are from everywhere, editors, services, even a bunch I did myself back in the ripping my dvds days.
out of the 750 I would say about 350+ lost all their tag information
(IE its now just the filename)

this is just one crate, and one of my smaller crates.
this is going to be a process

man you don't know how BAD i wish the 62 worked with 1.9.2, sound like alot of the same that going on with my files, i even have to run some thru handbrake, overview wont save when i encode them with the sl preset there fine

that was ANOTHER reason for the switch.

the 2 spots in NY I do have 68s, and I convinced my fri residency to buy a 68.

I didnt like being the dude who rips their booth apart to run my 57 anymore.

** update

so after all is said in done
with this one crate.

750 vids to start.
1/2 reverted to no tagging information (so, Ill be re-writting everything)
38 came up corrupted.
*
with the corrupted, I deleted them from my serato crate to the trash (CTRL+SHIFT+DEL)
from the bin I made a folder and moved em to that desktop folder.
from there I used the SAVE AS function in MPEGSTREAMCLIP

of the 38, 4 were unfixable...would not even open in QT or VLC.
I deleted 10, just because I had better versions.
and the remainder I dropped back into SSL post-mpegstream clip and they seem
pretty happy now.

Trying to figure out how to batch convert in mpegstreamclip now.
compared to my other folders, this one is NOTHING....

for the files that got corrupted; what i would do...
try finding their sisters, the not yet corrupted ones, on your backup hd and batch convert those in mpeg streamclip. then reanalyze them and see if they corrupt again.

what I noticed is, its not the SCANNING process that corrupts them
they are being initially READ as corrupt.

so when i drag the folder into SSL, and watch the files populate the crate
you can organize by the far left column BEFORE I drag them to analyze.

and the fact that Im seeing alot of 1 editors older videos all being corrupt
but being remedied by the mpegstreamclip fix leads me to believe its
a. something in their container (mp4)
b. something in their tagging.

I just started a larger folder, (3900 videos) I pulled the "read as" corrupt files out of the
folder BEFORE I started analizing...
and while Im only 150 scans in... it will be interesting to see if with these files out
of the mix, will I still get the crashes that so many people got.

What I would say to you Joshua, when all this is getting you down, just repeat the mantra to yourself; "I've only got to do this once, I've only got to do this once"....



...and hope that's true ;-)

I went back to 2.3.3 this weekend. Using an SL2 box and am still getting random rewrites. I've started from scratch again and tried the suggestion of adding the files to a crate and than analyzing them.

^^^ HA! Im married, i know that mantra well!


im looking into networking my i7DualMBP + my wifes corei5 MBP and my Imac(dual)
see if i can curb all this processing

Josh,

Does anyone know why the taggin info gets lost?

I just fixed all of my vids on 2.2.2 and don't want to have to retag especially with year and genre I have a lot of old stuff that I don't remember the years for.

Id wager it has something to do with the way it reacts to not being able to write directly to a file...
ya know, how it creates that assosciated file which will store all the data in stead.

those files get deleted... boom.
when i rescanned everything I started literally from scratch.
did NOT bring any of the info files over from 1.9.2

oh, well the good thing for me if I ever move to 2.4 or whatever I went through and found those files with ovb/xml files and deleted them and ran the mp4's through mpegstreamclip already.
I'm sure there are a few left, but shouldn't be many.

So, it would seem im hitting that CRASH road that everyone has been talking about.
(I started an idivdual help ticket)

now in my Dance crate/folder which is about 3800 videos.
as before I took out the ones from the get go that were corrupt.

of the 3800, I made to about 1200+ before I had a crash.
I tried to look at the overview log, but it was blank.

I had read somewhere that once you build an overview in 2.3.3 it knows this.
so you can reload you files to analyize and it will pick up where it left off
(IE NOT analize the files AGAIN)
TO TEST this theory I did a group of 100.
then tried to do them same exact files again....if this theory is correct, than it should NOT do them again...
guess what.
it did,.. arguabably alot quicker than others I think. I didnt pull out a stop watch.

So now, here I am.
I put the files in the crate in order by the #
and now Im doing 200 at a time...
the first batch 01-200 I had a crash.

the second time, i did not.
I wish there was a way to tell if a file had been scanned.
I used to think that if it displayed the "LENGTH" column it HAD been scanned....
if not, it hadnt.

help ticket: serato.com

The most scary thing is, that it does not reproducably always crash on the same file (at least not for me).

-Start the analyzer
-see where it crashed
-now recover all files from the backup
-start the analyer
-quite often it will crash on a different file and not crash on the file where it has crashed before.

marx recommended to do them alphabetically.
so you know where it left off

You guys know that there is an overviewbuilder.log file. On of the last few files listed there should be the "bad boy".

On=one

Yeah.... but like puma said... one time it made it crash.... the next time it didnt....

its weird like that.
and when i opened the file...it was empty.

the 2nd time I got a crash, the log was populated.

what Ive reverted to doing now, is putting the files in order by "LENGTH"
it seems only anylized files display a play length

I'm confused... that's what I said ;)

The way I did it was to put my video files all in one crate, sort by location, then drag+drop those files over. It should respect the order. Then by looking at the log file it is easy to find out where it left.

If the log is empty (I haven't seen this happening) then there is another OSX terminal command which can log file access. I used this command, can't remember it now, but I can look it up if you want/need.

It's a huge hassle though, and to me it sounds like this is the infamous QT multithreading bug.

yeah, i figured with the crash, it would have created a corrupt file.
nope.

well, now it seems the best way for me is do them by length.
the last crash i got I was able to see which were the last 4 files it ran.
and I tried them same files again, and they scanned...

at least using this method I know Im scanning every file once.
I just hope if its a bad file it doesent scan it first, apply the length...then crash.
becuase then Im just sitting there with a potentially bad file.

one way to find out.

My scan process would crash overnight or day while at work.
Seemed to be as Jack said at the 1000 mark, and it did pick up where it left off.

However, this is a fresh initial scan, not a rescan/update from a prior version.
Am I correct that this new 2.3.3 creates a V2 database when scanning this time around?
Do you think that has anything to do with this?

@Josh, I notice you are scanning 9 at once and 5 on the other machine.
Is this possibly slowing the machine to a hang point where it crashes?
Seems mine only did 2 at a time when I did my folders.
And if the machine is getting to this threshold, is it possible that errors are caused because of it and tossing the tracks?

Just throwing it out there, curious as to why this is happening to you.

I feel like moving to 2.3.3 straight from 1.9.2 is probably one of the hindrances for you, JC.

I'd gone to 2.0, 2.1 and 2.2, then back to 2.1.1 before I went to 2.3.3, and all of those had different files they didn't like. So it was more of a gradual process for my library.

When I finally took the plunge to 2.3.3 I don't think I had any crashes in analysing. A few more files came up that it didn't like, but not many.

Joshua,

What operating system are you using? What version of QT? Is this a fresh version of Serato? DO you have Serato Video or ME installed? Is this a dedicated system that had a clean install done on it, or a machine that you use for other things?

Many of these things can cause issues...just looking at where your baseline was.

haveing the same issue with the tag info. when i import new videos the only thing that shows is the artist and title but its all under the song category. ive been going in and redoing the tags manually. media rage doesnt seem to want to play nice with my mp4 files. the only luck ive had with redoing tags is with media monkey, but i just reinstalled osx on my mbp and dont want to put paralells back onthere to run windows.

@rick
thats how many precessors are working...
you can go into the OS and disable hyprthreading... but my 09 i7 runs 4 files
and the 11 i7 runs 8.

its certainly seems to be the way certain tags are written or containers.
after going through 6 or so crates now its very obvious that there is a obvious pattern
on what the 2.3.3. engine does not like, fortunatly it picks up MOST of those tracks on the initial read, and i can pull them, mpeg streamclipthem, and drop em back in before i even analyize.
Over night i polished off two folders one was 2700 files(on the 15i7), and the other was 1600 (on the 17i7)both chugged straight through the night and finished up as expected...
not a single crash.
which was huge relief.

I can imagine if i did not PULL the files that were labeled as corrupt before starting
the analyze i woould be in a world of hurt.

@Justin
Im doing this on 2 computers and getting Identical results.
(and even more over, getting the same results in the countless other threads about
the new 2.3.3. overview engine)
one is Lion, one is snow leopard
one has nothing but 2.3.3 on it
one has a shit ton of editing suites, SV, VSL, ME and such
one is on the internet all day, one rarely see's the internet

so its total opposite land on how these computers are.
yet, same results.... which it doesent take sherlock homes to see which way the wind blows.

@PhatBob
yeah... but you know doing a full blown fresh rebuild of the library is good
Ive certainly found some files that might catch me someday with a crash.
after seeing the tag-re-writting fiasco that happend between 2.0 and 2.3
Im glad i avoided it... and alot of people who had been moving along with the release
also have tickets open for the same issue

**25 Apr. 2 days til gig.
Im now down to 3 crates left.... 2 small ones, and one pretty big one... the one I forsee
is going to have the most problems. 3500 hiphop videos.
but if it goes like last night did Ill be happy.

Bullshit. Having ME or SV or VSL has absolutely no impact when analyzing the songs.

Why is it that people always think they need to say something even when they have NO freaking clue?

^^^^ this is true, i hadn't even installed serato video yet but had 2.4.0 my videos showed up anyway from my crates, & showed as corrupted

Let's see I asked about what OS X install, clean or dirty install, what QT version and if he had SV or ME...Let me see...you take offense because I dare ask about ME.

Well the Serato guys think there must be a link because they just moved the help request from the SSL thread to the SV thread.

To take offense, pretend or real, just because someone is looking to see what links there are that "could" be causing the issue is completely asinine. But I expect nothing else from you nikky. Your continued brilliance keeps shinning through. Keep it up.

yeah, but given the two systems Im running to accomplish this any of that sort of talk is
out the window from the get go:
www.facebook.com

ironically, they moved my help ticket from SSL to Serato Video....
which I thought was weird.

maybe thats why this never got properly addressed.
its in that grey area where the SSL guys see it and say, oh thats a video dj problem
and the video devs see it and go Oh, thats a scan/overview issue.
and in limbo it goes....
and seeing how in 2.3.3 it supports mp4's natively... Id lean to it being something in SSL
becuase I could do all this without VSL even installed.

HA!
Justin Called Nik, Nikky...UH OH

come on guys, dont get this potentially informative and helpful thread LOCKED!

As usual Joshua...I didn't start it. Mr. nikki "cheap shot" 39 did...again.

Joshua,

I actually think there is linkage with the newer verso of SV. True you don't need it installed but I am not sure that the "hooks" on both sides may not have something to do with it. AT the very least I think that video related issues are being looked at more carefully...just to make sure.

I might be inclined to think video files could play a role in this unless a non video dj can document that the same crashes occur.

The reason I say this is that scanning files is a very processor intensive operation.
The fact that it must be done with the interface disconnected also supports so as to free up resources to do so.

I now understand the processor cores role in this, but still wonder where the reason lies, just like heat can play a role in streaming playback.
If you look at it like an electrical circuit breaker that pops under load and heat, it makes perfect sense to me.

Recently I copied my database file to a copy drive which works perfectly.
Since then, my original drive that was working fine is trying to reload the tags when it opens. Even this process of reloading the tags prevents me from using the drive due to latency associated with that process. What changed and why remains a mystery to me.

The other thing is why previously scanned files that ran fine are choking and reporting as corrupt is not making any sense at all, but there may be things I don't understand in that process like I understand about other dj software.

Rick, Was your back-up drive named the same as your primary drive? Also...start a new thread, I would hate to derail this one.

The original was named Video E and the second was Video E BU
Weird as hell that the original worked and then began this nonsense.
The BU drive is working fine with the copied database folders.

I would bet you changed your linkage structure because of that...things started looking for files in one place...when they were actually in another. The database got confused :)

Further confused now.
The original drive that was scanned and working, is not reading its database but rather re loading the tags.
The path did not change, if any logical answer it would be the second drive not reading or loading the tags would make sense.

Not wanting to hyjack Josh's load up here, but seems the tag issues are pretty complicated.

happy to report I made it though another 2 crates today.
one with 1100 and another with 750.

no crashes.

Im pretty convinced after removing the files that are initially read as corrupt
you are bringing the law of averages waaaaay down on crashes during building
when you finally venture into analyzing.

one crate left tonight.
and a SHIT TON OF TAGGING :(

Not sure if I missed this in one of your previous posts...but have you tried re-tagging one of the files that lost the tag, loaded it onto a deck, and checked to see if Serato either tries to re-write the tag on ejecting or loses the tag data again?

I'd be interested to hear the results of that.

Ill give it a shot...

as i mentioned I have a TON of tagging to do.

Im also (as puma has mentioned) goin to try to fix those pesky files that write xml files and dont allow tagging in SSL.
theres a handful of videos, you re-write the info to you liking... it writes
then you load the track and it reverts back to its original txt.

until now, the only way I found around that is to write these in MP3 Tag

side note

out of all the files Ive scanned, audio and video
its resulted in less than a dozen metadata files to be created.

I've noticed those XML files in my Serato folder, always wondered what they were. I bet the files in there match up perfectly to my videos that constantly revert back to the old tag. I'll follow Puma's tip and see if mpegstreamclip will clean them up. Thanks for the info.

Good luck tagging, and thanks for keeping us updated on your switchover. Lots of useful info in here.

after knocking out about 20 I didnt see that happeneing
only when i set a cue point (obviously)

Anyone using iTunes upgraded to 2.3.3?
I'm wondering how having that as your crate structure affects this process.

Eloy does.

Good to hear. Sounds like a full re-scan is the way to go.

I took offence also not because you asked about m.e. but because you such a vsl/sv fanboy and your just sitting there waiting to defend almight sv....

I rebuilt all my overviews without sv installed on a pc so no, M.e could not installed on a pc, it crashed and it crashed on my mbp also when I tried to rebuild with them I also recently rebuilt again using itch on osx no video installed...did it crash YES(Although only once)

Imo it has to do with the process of building overviews and metadata/poor encodes....nothing to do with a video plugin be it sv or m.e. it scans without running either plugin so the blame is def not there.

i use 2.3.3 and 2.4.1 with itunes. i use a mix of crates & itunes smart playlists. i didn't have any issues scanning whether i had itunes enabled or not.

So.. which part of


did you not understand?


Because... he is using videos?


That's because you don't seem to understand even simple things.

djnak got it right.
Joshua got it right.
....
Again, in clear and simple words:
Whether you are using SV or ME has NO impact on analyzing videofiles. If you had a clue... well then you would have a clue. Until then...

Seems like it's not only the name which you both share:
Watchwww.youtube.com

Joshua, after you have finished your switch, this might be worth having a look at:

serato.com

I can consistenly make SL crash with this procedure (it crashes on a different file though!). Let it run over night, and you'll see.

This is the command to log the file access:

1. fs_usage -w -e filesys > cap.txt

(this will record eeeerything)

1. fs_usage -w -f filesys PID> cap.txt

Replace PID with the process ID of SL (you can find out the Process ID by using Activity Monitor). This will record every filesystem access of SL.

1. fs_usage -w -f filesys PID |grep "PATH" | grep "open" > cap.txt

Replace PATH with the path of your video files (eg "/Volumes/ExtDrive/videoFiles/"). This will record every filesystem access of SL and filter out by PATH and by only filtering opening file actions.

I think you have to be root to run these commands in the terminal. It helped me finding out which was the list file SL accessed before it crashed.

thats some wild shit.
once i get settled and comfy in 2.3 I will


**today.
Im Pretty happy today.
The folder I was SURE was going to give me headaches did not!
all files scanned with not ONE crash!
granted, I pulled 135 files out of it as corrupt.

and just as i was about to commit a good hour of clicking and cmmdS in mpegstreamclip
I FOUND the batch function!!! I had asked before, maybe people didnt see the question.
but... in case i stumbled on something here.
you goto LIST>BATCH LIST and it pops up a lil automator.
point to the files, point to the directory, choose action and go!!!
135 files DONE in 10 minutes!

What will mpegstreamclip technically do? The same as mp4box?

what about handbrake? i'm not a video editor i don't know anything about correct settings, i just dropped it in handbrake & used the serato preset


is handbrake not liked?

from what I understand, the SAVE AS function in mpegstream clips strips all the metadate and tag informatoin
(and in this case it would seem thats the EXACT information thats making SSL make these as corrupt, not after analyzing... but after LOADING them into a crate)

Im not 100% sure if it repackages the container or anything as well.

but out of the 300+ corrupt files I got out of this process this fixed all but maybe 6
it doesent change anything, its not a long process, a video takes about 8 seconds.
and like I said the batch convert zipped through 135 in 10 minutes.
so theres obviously no conversion going on.

and once they are reloaded into serato they are clean and not corrupt.

**
I did have 1 curveball last night while tagging (and i saw it in 192)
files that were scanned, and were ok
I load them and the play marker is at the END of the track, and cant me moved.
and the file CHANGES to corrupt...

I believe it does repackage the video into a new mp4 container.

Also you will want to slightly rename each file to ensure there are no other issues with ovb/xml files and some weird issues with waveforms not sticking, but there is no ovb file, like there is a 3rd area ssl stores data that is unknown to any human.

^^ this



The twilight tag zone... It's out there... Somewhere...

Gotcha, then it is doing the same as mp4box. mp4box is commandline driven - me likes mp4box better ;)


Not funny... because the xml metadata files is this X-area!

^serious about the 3rd area. Certain files, will have no waveforms and bpms won't show in itunes. It's like serato and itunes have their own databases for metatdata, but no ovb/xml files are there.
Cue points stick but waveforms don't

well, its done!
and thank god!

Heres what I can tell you so far about stage 1 of the Process.

I was happy to see that after everything I scanned from scratch, I only ended up losing about 10 files... and to be honest, they were questionable from the get go.
nothing Im going to miss, or cant re-download.

I ended up with about 20 files creating metadata.
so going forward Im going to get those fixed so I can delete the metedata info.

Give yourself a solid week to do this... I ran 2 Macbook Pro's
which cut the time down a ton.
analyzing on 2 machines proved to be worth the risk.
the only set back is that when I drop the files onto my gigging machine the length column
is blank... but the cue points, adjusted tags, waveforms, everything else pops right up even
though another machine wrote all the info
(you could not do this before in 1.9.2; you would have to move your metadata folders too)

The biggest, and most annoying headache still stands ahead of me
re-tagging thousands of videos..
but Im doing it real slow with a fine tooth comb, doing all the things I wish I had done from the get go before, IE filling in the actual Subgenre, putting the source in the album, leaving notes where needed, deleting videos Ill never play, marking all my random cool videos with shit audio "STOCK" So i can access them for songs with no video...

but the journey is not over.
I still need to PLAY OUT WITH IT!
so, that will be interesting... I also need to start grid marking everything
so I can use the Grid-effect feature in ME... which was ONE of the main reasons for making the switch.

also to start to mess with the DJ_EFX.
but I hear there are issues with that.... anyone have any solid info on that status?

Ill probably report back after the weekend, got two 5 hour video gigs.

if your filenames have some info (artist-title) mediarage can automatically pull this information using regular expressions. you'll need different regex's for the different combinations, but it will save you some time in tagging.

the grid in 2.3.3 is actually quite accurate. i've only had to manually edit about 10%. and most of the editing is because the 1 starts on a double drum or something crazy like that.

dj fx are dope especially when using them as in insert effect on the 62/68. my fav is touche le roof and roll out. i have not had any issues with using them.

thanks nyce

yeah i was looking at the presets that read file names...
i just have somany different combos, the only ones would benefit are the ealry extendmix ones...

I have to find those efx presets.
thats one thing Im totally green to...I always use the 57s

I didnt like being the dude to have to put your mess back together hahahah

Doesn't SL do this by default if it can't find any metadata?

If it does I'm missing out!

Lol
No, I mean in programs like mp3tag u can set up a way for the program to read the file name and create the proper tags from that

IIRC, it does just parse it by a simple scheme:

Bla bla - Ble ble - blu blu.mp4 ->

Artist: Bla Bla
Title: Ble ble - blu blu

Looks like they've removed it in 2.3.3 due some bugs in the implementation :-/

ok, tonight the proof is in the pudding.

side bar
the 2nd page of my x-1 has been naked for some time.
now that I have the dj-efx mapped and some effects chosen, im pretty stoked to
mess with em.

good luck

so, no crashes.
thats good.

things seem to run pretty smooth, cept for a few lil things.
I did have 2 USB audio pops (I wouldnt quite call them a full drop out) (both nights)
I also had 2 SSL freezes (4-6seconds) but the video kept playing on the screen, s did the music... SSL just seemed to lock up a bit

I also noticed that midi signals are not as smooth as they were in 1.9.2
I had to remap my x-1 and it was certainly a lil more glitchy then it ever ad been before.

it was kinda good, the club had no internet friday; so i didnt run the internet, or the twitter feed, or the video feed... just straight up runnin 2.3.3 + ME.

saturday night I had it all going.
same results.

the biggest headache, as i said was not having my stuff tagged....ugh.

Was the freeze caused by tag rewrites on track ejection?

Are you using the new update for the X1 controller software?

How the HELL???? Ido this in handbrake and it takes about 10-20mins a video file! how the fuck you do it in 8secs???

My macbookpro specs, 15'' / 6GB Ram / 512mb GPU/ 2.8Ghz Core 2 Duo/ 750GB Hybrid 8GB SSD HDD/ OSX 10.6.8

is mpegstreamclip really this fast?

He's doing a 'save as', not re-encoding. It takes seconds.

yeah it's just making a copy of the file vs reencoding it.

huh? so surly thats the same as copy and paste? lol. not sure how this is fixing files? But seems to have worked. There sure is some random things going on with videos.

But now i understand why that was taking like 8secs a video lol. for a min i fort my mac was fucked lol.

It creates a new container which will then have the correct headers and will support tags. The audio and video content is the same as the original file.

yeah more than copy and paste, but that's about how quick it works

exactly.

ok gotcha, it just puts the package into a new container, and this is where serato is detecting the corrpution. Take it this can not be done in handbrake? (should go get mpegstreamclip?)

mpegstreamclip is free and does it very easy. not sure of what handbrake can do as I don't use it.

ya i did used to have that but it does not work with lion and i have now gone back to snow leopard so will get back on that shizzle.

Yup, and it does a batch "save as"
So load 100+ corrupt files, run batch save as to mp4
Done.

Seeing how it seems alot of the corrupt files have to do with TAGGING and not the h.264 and AAC/mp3, stream clip seems to strip all the tag information.
And your starting with a fresh file.

@justin I had did the NI update maybe around Xmas, but I don't run any extra software WHILE runnin the x-1 . No midi pipe, or anything like that.
It certainly worked, but it's almost as the button strikes were being buffered...
Example: X = midi button key strike 0: how it played
X...X....X . X.X.X
0...0....0 . 0.....00

Also a few time when scrolling it took a few LARGE turns of the knob to scroll, where as before, 1 click turns on the knob would result Immediatly I. A response ....
Almost as if I had to "wake up" the midi signal.

Joshua, I don't get this issue but another DJ who plays in my clubs does...kind of. Sometimes the crossfader on the DJM-800 moves really slow in the sera to window and the solution is to unplug the midi cable and plug it back in...it works with no delay after that.

I wonder if somehow they might be "midi" related.

Joshua, I've had zero issues with my midi devices on 2.3.3 (up to 5 devices some nights), but I have noticed a few posts in the SL help area about similar problems with the X1. Worth a look over there, or maybe start your own help thread.

Could be something up with SL and the latest NI software maybe?

U Got a link?

Side bar...

serato.com

it would seem, as predicted my help request still sits unattended after they moved it from SSL to SV support.

Joshua, First and foremost thank you for taking the time to post your results during the transition from 1.9.2 to 2.3.3 !! Lets just say this transition from audio to video has been one big pain in the A## for me !! After trying all the upgrades I have come to realize the only stable version I could get to work with my PC was 1.9.2 !! I've been running that now for three months !! Not going to say this is going to fix all my problems but I finally decided to buy a MAC !! I'm using the Rane 57 along with pioneer 850's !! I'm hoping to pull this whole package together with ME !! What version of Serato would you recommend starting out with knowing what you know now? I know all to well about the tagging issues,corrupt files and view box disappearing when starting up !! All of these were problems I encountered when I was making upgrades with Serato !! Now I'm faced with a new operating system and need to decided what version of Serato I should start out with !!
Thanks SURF

i re scanned my hd, analysed and re converted the corrupt files.
biggest problem i have is cue points have dissapeard on a lot of my tracks man those were some dope places i had in some and i have forgotten a lot of the,.

one thing i hate about reanlyizng and rescanning id tags.

Josh, How is this going? Any issues while playing out live? Was it worth the headache?

well, another wekeend passed.
Ive had at least 1 usb blib every gig, nothing crazy.
Just a solid, audible pop.
(Ive trouble shot the usual suspects, (3 different wires...)
Im curious if having the wi-fi on REALLY does have anytrhing to do with it.
Ive been keeping it on for about 6 months, and never had an issue before.

Renaming all those vids has been the on going headache.
I still have thousands to go.
but im happy to report I have ZERO metadata now...
I repackaged all the files that gave me meta-data and all is right with the world
(there was about 30 files... 10 of which I just deleteed)

MIDI.
this has been the performance headache as mentioned here, and in my help ticket.
no hardware has changed since 1.9.2
so my serato "buffering" my x1 cue point strikes kinda baffles me.
even some times when im NOT drumming a cue point... just a singular cue point hit
will result in a double strike (very raid) and the cue button remaining on
(of course Ive ensured the midi signal is not on toggle or anything wierd)

but performance wise 2.3.3.18 has been good.
a little glitchy here and there, a few hangs (gaaaaaaaaasps) on occasion..

Very Rapid*
(Imagine trying to get a single shot out of a controller with turbo engaged)

Josh,
Makes the cue go da/dump on the down beat with one strike.

This has been a problem on my Denon 6k unit and I posted on it in the Gen forum under the 6k thread. Nobody else posted they had the problem, the opposite actually. That exact thing happens to me and all I can do is make one slow defined strike on the key to get it right but it makes cue hopping impossible.

It does not happen with my coffin w37's but my hot cue 1 is less responsive than my main cue button which is noticeable. Somethings up, and you know I use more than one program and without this difficulty so its not the gear getting stupid.

that sounds like what happens when a file is ejected and it is rewritten.
it's the main and only reason i won't upgrade.

wish serato would end this.
it would be nice if more people would reported it.
i can't since i don't use the versions that do it.

I can tell you this; everytime I've had anything it's been mid track, no tag writting, loading...ect ect.

I'm curious if people are confusing legit tag writing with bugs
It writes tags, briefly. But that's because every track I load I'm re-establishing cue points.
So, a tag write on exit IS necessary .

But no other tracks are doin it.

Yeah, Rick exactly. "da-dump" on the cue strikes.

oooh, mid-track...odd.

when testing 233 i never got a hang ups except when loading a new video. the tag writing thing was happening. but i only tested it at one gig for 4 hours.

yea, yours does not sound like a tag write issue.

For me and others it also happens that sl writes tags although no changes have been mad to the tracks!

Yup, 60% of the time it happens 100% of the time. Serato writes tags after ejection without any changes made to the track.

nik and niro know what i mean...

have people reported this?
maybe it's suppose to do that, but imo it should not.

It should not. I know that I have reported it. But the more people complain the better. ;-)

due to this thread/my own issues updating serato versions/ the results of a bit of testing here and there I have decided to rebuild a new library....

the work flow is gonna be something like this:


1 Mpegstreamclip save as (Mp4) each and every mp4 in all my video folders to a folder simalarly named on a new drive

2 add said folder to serato 2.4.1 retag and set cues (loosing metadata is not really an issue for me cause i have pretty much changed all the filenames with codes and all files are in genre specific folders so retagging is quick and easy)

3 repeat for every folder in my video library

and because I am a m.e. user and I want all the grids built(The main reason I am setting my intail cue on all tracks or I would have just skipped that part and set cues as I loaded tracks to play)
My last step once all metadata and crates have been rebuilt I am going to analyze them all in itch (adding the beatgrid for M.e)

after noticing how fast serato built overviews/ mixed in key scanned and wrote/and how fast mp3 tag wrote tags to clean files(I mean literally they all ran about 5 times faster) I was sold on this it is going to be a huge pain in the ass but Serato 2.3.3 should run flawlessly now with all these "cleaned up files"

video of ghost midi:
Watchwww.youtube.com
(sorry forgot to flip phone sideways, its 720p though)

if you notice when the midi in depresses, its a static signal.
as if someone is holding down the button.... not just tapping it.

question, do you have to re-analyze the videos.
I just opened up 2.3.3 and everything looks the same, granted this is in offline mode though.

Anything before 2.3.3 is going to need to be reanalyzed.

So I started my journey into 2.3.3. I started by take all scratch live folder on my internal and external hard driver and deleting them (putting in trash bin and deleting them off my computer). then I started with my Video folder. I dropped all my video's into scratch live. right away 17 corrupt video's. I have some ambient files but hey i didn't use them much and I have back up of them. So I started and so far so good. Now my mp3's might be a different story.. Got a hell of a lot more then video's

I'm never upgrading past 1.9.2

i used to say the same thing, than i bought my self a few 62's

After reading this thread, I am completely scared about upgrading. I signed up to dj, not become some expert IT person....I am using 2.2.2 because I have an SL2, but I stick to 1.9.2 if I am using an SL1 at a club...

Is there any hope of some type of work around? This seems like a lot of work to just get your videos running nice....

Hey Josh! Enjoy your video report btw. Do you think your done now? Would there be anything you would do differently if you had to do this all again? Is there anyway to make the jump to the newest software w/o losing all of your tags?

lol.. 62 is alright not enough to make me upgrade...
I would get a djm 900 n i have 2 sl1s make a ghetto 68 and be able to use 4 dicers, 4 video decks and 2 laptops lol ;) beat that people

same questions

Ok So I figured something out about corrupted files.. I downloaded the files all over again and go the same results. So I moved them into a seprate folder and added them back into the correct folder and they worked just fine. So I figured if you remove the files and move them to a different folder they wouldn't show up corrupt

there is a secret hidden metadata database for serato that I can't figure out so you have to either move the files or rename them ever so slightly.

One thing I've noticed now that I'm now editing all my stuff in 720p (used to dumb stuff down to 480p or less for my old '09 MBP). That I usually get a tag write with the HD stuff, but none of my older SD stuff.

I just analyzed all my videos on 23318

Only files that now have ovb/xml files are a few m4v's

Wasn't as painful as I had thought.

lol mine was....all is smooth now, no ovb/xml in my crates

I went through and did a search in my video drive for mp4 and sorted by date.
Most had yesterday through this morning being last opened, but several (400) didn't

I took all of those and analyzed them again and they don't show any change in the date last opened.

I thought I was screwed so I took one video and edited the metadata in SSL
(intro-dirty) to (intro - dirty)
I closed ssl and opened itunes (use itunes for crates)
and the file changed once I got info on it.
Still doesn't show the change in time though.
Very weird

so what should we do with files we THINK are causing hang-ups during analyzing?

Ok so i am FINALLY starting this process, my 62 is collecting dust! I pre orderd and got it the day it came out. I have all my videos (50,000) on an external WD 6TB USB/FW800 Drive.
They are all in folders according to the video pools i am on. Xtendamix, BlastVidz, VideoToolz etc.
I am doing a folder at a time starting with the Xtendamix folder 10,000+ Files.
Ran overnight crashed about 2,000 overviews in, checked the OverviewBuilder.log found the files (s) it stopped on. Re opened serato and re scaned those (with no crashes) and now on to the next batch. At about 3,000+ more and so far so good.


I have a few questions:

1) What are the ovb/xml files on my external hard drive for?
How do I get rid of any ovb/xml files on my hard drive, to clean up space/efficiency.

2) When some of the ID tags are being read/written a message comes up on the bottom info bar saying something about file being corrupt. What exactly is happening?

3) When re analyzing all my video files will I lose cue's/loops/video fx?

Thanks

Holy cow!

you will lose some tags and cue points, but seeing how your coming from post 2.0 it wont be as drastic as coming from 1.9.2 and before.
prepare yourself for some re-writting and re-cue'ing.

you can get rid of 99% of the files with ovb/xml data by using mpeg streamclip (as i described above somewhere)
pull all the files that have that data, put them in a folder, batch "save as mp4" with mpegstream clip.
this basically repackages them in a new mp4 container.
tag em, reload em and re-annylize and you should be good.
I have none now... and i know a few other guys did this as well

#2, I cant answer exactly. sometimes even a corrupt files just needs to be resaved in mpegstreamclip.

Still chugging away, thru 5,000 of the 10,000 Xtendamix, all seems good so far.

hope you got a quad core for all that analyzing

50,000 is a lot of videos. The most I have at one time on my laptop is 3,000.

Youre also not playing country hick stuff like the Canucks do :P

I play many different formats, and yes in Canada sometimes country is a part of that.

make that $$

I think my 2tb of videos are too much but damn.. good luck dude!

Also for the Beat Grid Analyze function I know Serato does it automatically, when building overviews, but does it do it automatically when loading an un beat grided track in a live dj set?

Update: Made it Thru The Xtendamix folder 2 crashed for 10,000 Files. Not too shabby.
On to the DT Videos folder 3807 files. Good thing I can analyze 8 Tracks at a time!
Next gig friday, hope to finally use that dusty 62!

The beat Gris is pretty accurate for most quantized EDM stuff.. But I always go in and do some nudging after

Check your BPM's

Beat grid is great with the exception of videos that have been edited with a dj's intro. Have to set them manually.

And yes, 50,000 is too much.
I have about 4000 on my laptop and move more off everyday.
I do have an external that has every 80s/90s/House, etc videos that I might need for a genre or decade specific gig, but not play at your average club/bar.

Too much is just that, too much.

Update Again.
I got my 50,000 total vidz from clicking on my hard drive "get info"
That was number of files in my video folder, bust have been including other files that contain info (overviews, xml, vob, .als etc)
Total Files To Scan now about half 25,000 (still way to many I KNOW)

Xtendamix 10,000 Files 6 Crashes
DTV 3,00 Vidz 4 Crashes
Armed With Harmony 3,000 Vidz 2 Crashes
Club Dj Vidz 3,000 1 Crash
Club Killers 0 Crashes
Smash Vidz 13k Vidz ...Scaning Now.
Plus A Few Small Folders From Other Pools/Friends/BlastVidz

Hopefully be done and able to back up again/test with the 62 before my next gig on friday!

You have just downloaded every video and every remix from those sites as thats the total number they hold. You could delete 60% or more of that and never need it like your guna need every remix every single xtendx intro ect ect dirty and clean. Way ott.

But each to there own i guess.

I think we are off topic. How has everybody's re-scan's been? I know 5-6 top video djs that said, fuck it, just updated no re scan and have been fine. Crazy!

The crashes most likely have to do with bad/poor metadata and the xml/ovb files.....I have updated already and went through this, but I decided to rebuild my crates and start fresh last night....new hd/ new crates it analyzes about 17000 vids and still going NO CRASHING........

Mpeg streamclip is your best friend with this update, what you gotta remember is when we started doin this video thing there was no way for metadata to be stored in a mp4 container, and now we can, so we need to get rid of al the xml/ovb's

This is how you play open format and be ready for just about any gig thrown at you.....

Im not far off, last count was 22600 vids(and that is cleaned out lol It would probably be around 40000+ if I would kept it all)

There was points when I was in 4 different pools/personal edits and hitting up cc every week and sh and yr once a month....Now I am in 1 video pool and my own edits, and I really don't feel like I am missing out on anything except time spent organizing lol

Rebuilt my crates a few days and didn't have any trouble, only have about 5k videos but didn't have a crash and I'm on a PC......

Ya my new hard drive gets in this week, and i think it's time for all new crates/start from scratch! I'll go thru all edits i play and give it a proper home in a crate. Probably gonna mixed in key what i missed up to this point to. Seems like a lot of work, but then it's all done and im doing a live show, it will be worth it.

YES

I just redid my entire internal video collection on my new machine, using 2.4.3.21(rc3) and had zero crashes. I started fresh with no crates, no old data. Mind you I had zero 8th blunder, Videotoolz, armed w harm, club dj vidz, promo only, or club killers.

I did have Xtenda, Smash/Vj-pro, Crooklyn, one or 2 blastvidz, personal, DTV, and a couple friends/bootleg mixes.

I did have a couple of the cores freeze up (known bug). I have yet to load the external hdd files, but I dont think Im going to even load them onto the new machine's library (no need).

Update:

SV Done 3 Crashes
BlastVidz Done 0 Crashes

Few small folders/odds and ends and finished. Good feeling not to be rushing right before a gig. Probably play this weekend, then start fresh with crates and have early next week to re build some before next gig.

Pretty much in the clear now, just have to see the damage to my ID tags, and test all day with the 62 + plug ins. New toys exciting!

1st Night out last night with the 62, no crashes, just one small audio drop out, also played only part of the night with another dj.

Tonight is the real test. Upgraded to MT Lion 10.8.2 and full night with the new software/hardware!

2nd night. 10.8.2 and ALL Seems smooth!
Not looks like a good week of creating crates/sub crates and finally done!

Thanks to anyone who has helped!