| \n", " | embed_size | \n", "global_step | \n", "learning_rate | \n", "loss | \n", "state_size | \n", "vocab_size | \n", "
|---|---|---|---|---|---|---|
| 0 | \n", "56 | \n", "2 | \n", "0.189885 | \n", "9.211146 | \n", "380 | \n", "10000 | \n", "
| 0 | \n", "56 | \n", "203 | \n", "0.189885 | \n", "5.385020 | \n", "380 | \n", "10000 | \n", "
| 0 | \n", "56 | \n", "404 | \n", "0.189885 | \n", "5.219425 | \n", "380 | \n", "10000 | \n", "
| 0 | \n", "56 | \n", "605 | \n", "0.189885 | \n", "4.849638 | \n", "380 | \n", "10000 | \n", "
| 0 | \n", "56 | \n", "806 | \n", "0.189885 | \n", "4.682628 | \n", "380 | \n", "10000 | \n", "
| \n", " | dropout_prob | \n", "embed_size | \n", "global_step | \n", "learning_rate | \n", "loss | \n", "num_layers | \n", "state_size | \n", "vocab_size | \n", "
|---|---|---|---|---|---|---|---|---|
| 0 | \n", "0.2 | \n", "32 | \n", "2 | \n", "0.5 | \n", "10.595644 | \n", "2 | \n", "128 | \n", "40000 | \n", "
| 0 | \n", "0.2 | \n", "32 | \n", "203 | \n", "0.5 | \n", "5.747638 | \n", "2 | \n", "128 | \n", "40000 | \n", "
| 0 | \n", "0.2 | \n", "32 | \n", "404 | \n", "0.5 | \n", "5.864061 | \n", "2 | \n", "128 | \n", "40000 | \n", "
| 0 | \n", "0.2 | \n", "32 | \n", "605 | \n", "0.5 | \n", "5.508001 | \n", "2 | \n", "128 | \n", "40000 | \n", "
| 0 | \n", "0.2 | \n", "32 | \n", "806 | \n", "0.5 | \n", "5.496625 | \n", "2 | \n", "128 | \n", "40000 | \n", "
| \n", " | Context | \n", "Utterance | \n", "
|---|---|---|
| count | \n", "1000000 | \n", "1000000 | \n", "
| unique | \n", "957096 | \n", "849957 | \n", "
| top | \n", "! ops __eou__ __eot__ ? __eou__ __eot__ | \n", "thank __eou__ | \n", "
| freq | \n", "14 | \n", "11658 | \n", "
| \n", " | Context | \n", "Utterance | \n", "
|---|---|---|
| 0 | \n", "i think we could import the old comment via rsync , but from there we need to go via email . I think it be easier than cache the status on each bug and than import bits here and there __eou__ __eot__ it would be very easy to keep a hash db of message-ids __eou__ sound good __eou__ __eot__ ok __eou__ perhaps we can ship an ad-hoc apt_prefereces __eou__ __eot__ version ? __eou__ __eot__ thank __eou__ __eot__ not yet __eou__ it be cover by your insurance ? __eou__ __eot__ yes __eou__ but it 's ... | \n", "basically each xfree86 upload will NOT force users to upgrade 100Mb of fonts for nothing __eou__ no something i do in my spare time . __eou__ | \n", "
| 1 | \n", "I 'm not suggest all - only the ones you modify . __eou__ __eot__ ok , it sound like you 're agree with me , then __eou__ though rather than `` the ones we modify '' , my idea be `` the ones we need to merge '' __eou__ __eot__ | \n", "oh ? oops . __eou__ | \n", "
| \n", " | UserOne | \n", "UserTwo | \n", "
|---|---|---|
| 0 | \n", "i think we could import the old comment via rs... | \n", "it would be very easy to keep a hash db of me... | \n", "
| 1 | \n", "ok perhaps we can ship an ad-hoc apt_prefereces | \n", "version ? | \n", "
| 2 | \n", "thank | \n", "not yet it be cover by your insurance ? | \n", "
| 3 | \n", "yes but it 's really not the right time : / w... | \n", "you will be move into your house soon ? post ... | \n", "
| 4 | \n", "how urgent be # 896 ? | \n", "not particularly urgent , but a policy violat... | \n", "
| 5 | \n", "i agree that we should kill the -novtswitch | \n", "ok | \n", "
| 6 | \n", "would you consider a package split a feature ? | \n", "context ? | \n", "
| 7 | \n", "split xfonts* out of xfree86* . one upload fo... | \n", "split the source package you mean ? | \n", "
| 8 | \n", "yes . same binary package . | \n", "i would prefer to avoid it at this stage . th... | \n", "
| 9 | \n", "i 'm not suggest all - only the ones you modif... | \n", "ok , it sound like you 're agree with me , th... | \n", "
| 10 | \n", "afternoon all not entirely relate to warty , b... | \n", "here | \n", "
| 11 | \n", "you might want to know that thinice in warty ... | \n", "and apparently gnome be suddently almost perf... | \n", "
| 12 | \n", "can i file the panel not link to eds ? : ) | \n", "be you use alt ? or the windows key ? wait fo... | \n", "
| 13 | \n", "i just restart x and now nautilus wo n't show... | \n", "do you think we have any interest to have hal... | \n", "
| 14 | \n", "be it a know bug that g-s-t do n't know what ... | \n", "somebody should really kick that guy *hard* i... | \n", "
| 15 | \n", "arse . xt-dev ? i add libx11-dev so just libx... | \n", "we have plan to speak about menu organisation... | \n", "
| 16 | \n", "be away , you say ? nope | \n", "the warty repository ok , fine . thanks nice ... | \n", "
| 17 | \n", "you 'll be glad to know i 've fix my miss arr... | \n", "i 've upload the gnome-vfs without hal suppor... | \n", "
| 18 | \n", "should g2 in ubuntu do the magic dont-focus-w... | \n", "we 'll have a bof about this so you 're come t... | \n", "
| 19 | \n", "interest grub-install work with / be ext3 , fa... | \n", "more like osx than debian ; ) we have a selec... | \n", "
| 20 | \n", "2.8 be fix them iirc | \n", "pong vino will be in enjoy ubuntu ? | \n", "
| 21 | \n", "tell me to come here suggest thursday as a go... | \n", "we freeze versions a while back : ) you come ... | \n", "
| 22 | \n", "thats the one | \n", "so i saw your email with the mockup at the ai... | \n", "
| 23 | \n", "i 've get a better one now too , give me a mi... | \n", "aha ! no , the gui thingy it 's more wizardy ... | \n", "
| 24 | \n", "i think experimental be get 2.8 too let him w... | \n", "we call it 'universe ' ; ) haha ooh , totally | \n", "
| 25 | \n", "i want it on in sarge too but nobody else agree | \n", "i fully endorse this suggestion < /quimby > ho... | \n", "
| 26 | \n", "and because python give mark a woody | \n", "i 'm not sure if we 're mean to talk about th... | \n", "
| 27 | \n", "and i think we be a `` pant off '' kind of co... | \n", "mono 1.0 ? dude , that 's go to be a barrel o... | \n", "
| 28 | \n", "there be an accompany irc conversation to tha... | \n", "but debian/ be also part of diff.gz ... you c... | \n", "
| 29 | \n", "notwarty , hth , hand , kthxbye < g > everyon... | \n", "which ? the best feature of the new imac be t... | \n", "
| ... | \n", "... | \n", "... | \n", "
| 170 | \n", "this mornings run fine . | \n", "yep , it be . could you add hurd-i386 amd64 t... | \n", "
| 171 | \n", "do - i assume that you 'll poke elmo to fresh... | \n", "do n't know i have to i 'll remind him next ti... | \n", "
| 172 | \n", "know bug . check bugs.debian.org/src : xfree86... | \n", "i 'm wait approval to join the sounder list .... | \n", "
| 173 | \n", "setuid /bin/mount be go to be disable in favou... | \n", "under all circumstances , i take it ? | \n", "
| 174 | \n", "i would say so | \n", "do | \n", "
| 175 | \n", "i will accept responsibility for the addition... | \n", "indeed . it 's a recommends : thing , fix act... | \n", "
| 176 | \n", "we need to make sure that cdroms ( and other r... | \n", "presumably i should make the same quietinit- ... | \n", "
| 177 | \n", "yes | \n", "do ( be the actual option change in sysvinit ... | \n", "
| 178 | \n", "sysvinit usplash will also check for it and n... | \n", "the patch as post be wrong , but i 've test w... | \n", "
| 179 | \n", "if it work , can you patch it and upload it ? | \n", "sure , let 's make it tomorrow though : - ) | \n", "
| 180 | \n", "np | \n", "hm , that eject change be go to need some tes... | \n", "
| 181 | \n", "pmount just wrap mount , so long as you be a.... | \n", "that 's not my point at all | \n", "
| 182 | \n", "i 'll double check that thats the whole reaso... | \n", "maybe just fall back to something like the ol... | \n", "
| 183 | \n", "thats a little difficult with the way it be c... | \n", "do n't have to be exact by any mean be it imp... | \n", "
| 184 | \n", "what do the fb corruption look like ? | \n", "lot of dot and squggles , text be partly read... | \n", "
| 185 | \n", "which package ? | \n", "^^^ | \n", "
| 186 | \n", "they build 'em sturdy down there , apparently... | \n", "over here they install fine , but then apt wa... | \n", "
| 187 | \n", "try apt-get clean ? | \n", "that fix it , thank | \n", "
| 188 | \n", "that issue should n't affect upgrade from woo... | \n", "pitti : i 'm in group plugdev , it 's still n... | \n", "
| 189 | \n", "one difference be that some pcs have a line o... | \n", "removable devices have be bad for me , but it... | \n", "
| 190 | \n", "i think we nail the issue ( executable permis... | \n", "it 's copy into their cache already , be n't ... | \n", "
| 191 | \n", "hmm , good point nono , ( b ) give the cd to ... | \n", "if we be use grub only , should we turn off do... | \n", "
| 192 | \n", "poke | \n", "try to remember if i ask if you be ppc or i38... | \n", "
| 193 | \n", "yeah , series 1 h8 that debconf should be con... | \n", "what kind of puppies ? awesome | \n", "
| 194 | \n", "you ping the other day ? ( i only just get to ... | \n", "i ping a few minutes ago do you make a usplas... | \n", "
| 195 | \n", "right click on the desktop be not work for me | \n", "nautilus manage the desktop ? the icons be di... | \n", "
| 196 | \n", "anybody else see fb corruption during boot ? g... | \n", "which video card ? | \n", "
| 197 | \n", "no , it 's my home desktop | \n", "i remember fb break on that laptop and iirc it... | \n", "
| 198 | \n", "that typically mean that apt be see multiple p... | \n", "there 's something definitely screwy with the... | \n", "
| 199 | \n", "stock warty apt-get install `debootstrap -- p... | \n", "what kernel be you run ? # 268154 , yeah , re... | \n", "
200 rows × 2 columns
\n", "| \n", " | Context | \n", "Utterance | \n", "
|---|---|---|
| 0 | \n", "Any ideas on how lts will be release ? __eou__... | \n", "We be talk 12.04 not 10.04 __eou__ | \n", "
| 1 | \n", "how much hdd use ubuntu default install ? __eo... | \n", "thats why i ask how much be default install ? ... | \n", "
| 2 | \n", "in my country its nearly the 27th __eou__ when... | \n", "thanx __eou__ | \n", "
| 3 | \n", "it 's not out __eou__ __eot__ they probabaly b... | \n", "wait for many things to be setup __eou__ final... | \n", "
| 4 | \n", "be the ext4 drivers stable ? __eou__ __eot__ I... | \n", "you sound like it 's update to skynet . ; ) __... | \n", "
| \n", " | 0 | \n", "
|---|---|
| count | \n", "2.156054e+06 | \n", "
| mean | \n", "2.171190e+01 | \n", "
| std | \n", "2.074356e+01 | \n", "
| min | \n", "0.000000e+00 | \n", "
| 25% | \n", "8.000000e+00 | \n", "
| 50% | \n", "1.600000e+01 | \n", "
| 75% | \n", "2.800000e+01 | \n", "
| max | \n", "8.550000e+02 | \n", "
You done got yourself a 404, my friend. How about we just hit that backspace button and pretend this never happend. OMG
A small framework for building and playing with conversation models in TensorFlow.
{{ message }}
{% endfor %}Have a chat with a deep neural network.
The bot would like to know who it is talking to. Feel free to enter a nickname for yourself below:
I've uploaded two simple models here that you can chat with. One was trained on the Cornell Movie Dialogs, the other on a subset (2007-2009) of the Reddit comments dataset. They both have the same model architecture. I'll upload the full configurations soon, but their key components are as follows:
Scans over hyperparameter space for the models, in order to first get a semi-quantitative idea of which regions to focus on (and it's fun).
All plots on this page show some value plotted every 200 iterations out of 10,000 total, for a model identified by the plot label (configuration/params shown at the end of each section).
The label will contain the main distinction/info regarding how the given model differs from the others on a given plot. Currently, I'm most interested in comparing performance for GRU vs. LSTM, number of layers, and how much the BidirectionalEncoder, AttentionDecoder, and combinations thereof improve the baseline (basic) model with BasicEncoder and BasicDecoder.
If you are reading this and know how to do curve fitting with D3 please let me know. I haven't looked extensively how to do it, but it is certainly on my list considering the jagged appearance of the plots right now (doing simple splines).
Below are plots on training accuracy, training loss, and validation loss for basic models trained on the Cornell dataset. Any time I refer to a model as "basic", I am saying that it uses the BasicEncoder and BasicDecoder classes (members of the chatbot.components package).
Below are labeled buttons that show the configuration parameters for the corresponding plot label. For ease of viewing, a parameter is only shown if not all plotted models have the same value; e.g. if all plots above used a batch size of 256 (the default), none of the buttons below will show a value for batch size.