Skip to content
This repository has been archived by the owner on Nov 9, 2023. It is now read-only.

Stop developing this technology #41

Open
alonsoir opened this issue Feb 21, 2022 · 134 comments
Open

Stop developing this technology #41

alonsoir opened this issue Feb 21, 2022 · 134 comments

Comments

@alonsoir
Copy link

This technology is only going to be used for evil purposes. To deceive people, steal their money, possessions, undercover operations. Nothing good. It is already being used for scams like the pig-butchering plate, in which hundreds of thousands of lives around the world are being left without money, causing a lot of suffering.

@iperov iperov pinned this issue Feb 21, 2022
@nofacedeepfake
Copy link

Well, ban cars, weapons, hunting, the Internet, computers. you wrote such nonsense. technology will develop, but without you. on the contrary, it must be developed. it was created for entertainment, and if a person uses it for other purposes, then let him answer for himself, it’s not the technology that’s to blame, but the person, not the machine gun, but the person. learn to recognize technology is my advice to you.

@alonsoir
Copy link
Author

alonsoir commented Feb 21, 2022 via email

@klimlp
Copy link

klimlp commented Feb 21, 2022

I think the whole problem is electricity! It needs to be turned off! This technology could be used to destroy our planet. Think about it.

@alonsoir
Copy link
Author

Sir, I wish you learn the hard way then the misuse of technology. If you are not capable of reflecting in the slightest, you are a cynic who will have to learn the hard way.

In the meantime, know that you have my absolute contempt and you must know precisely what your technology is for. To destroy life and plunge 80-year-old grandfathers and grandmothers into poverty. In your conscience, if you have it, it will remain.

This time it was my parents, tomorrow who knows, it will be theirs, or those of someone they know.

But what the hell, they should have recognized that they are fake faces, right?

@iperov iperov reopened this Feb 21, 2022
@iperov iperov reopened this Feb 21, 2022
@iperov iperov closed this as completed Feb 21, 2022
@iperov iperov reopened this Feb 21, 2022
@t-solo
Copy link

t-solo commented Feb 21, 2022

This technology is only going to be used for evil purposes. To deceive people, steal their money, possessions, undercover operations. Nothing good. It is already being used for scams like the pig-butchering plate, in which hundreds of thousands of lives around the world are being left without money, causing a lot of suffering.

Damn it, man. Blaming technology because of a case of scamming? Seriously?

How many people have been scammed by governments, banks, stocks, insurance companies, and so on? How many have been victimized by phone scammers, TV scammers, Internet scammers? Millions? A billion? How many lives have been broken? How many have lost jobs, families and even lives? Was it technology or human nature to blame?

You're talking about global things, citing an isolated case as an example. A drop in the sea. Do you know what % of those who use this technology will use it harmfully? What is the acceptable margin of error? I guess you don't have an answer. You're just looking for guilty.

These are realities of progress And reality is always worse than we think. So it was, and it will be.

Peace.

@Julia222222
Copy link

I am agree with the opositors to this post, technology is not good or evil, it is neutral, people who use technology can use it for good or for evil... if someone blame this technology, why not to blame guns, warships, tanks, airplanes, shotguns, machineguns before blaming this technology? I think a gun is more dangerous than this technology, and if someone use a gun, a tank or this technology to comite crimes then he or she should be judged in a court and put in jail, not the creator of this technology... and I am not agree this technology will be used only for evil, It can be used also in art projects, in the cinema, in the industry of entretainment... I have artistic projects and I personaly use it for it... this technology toguether with other technologies can be used to create characters like Alita (in the movie) and do art with it...

Technology is not guilty or inocent, people is guilty or inocent

@cast-e
Copy link

cast-e commented Feb 22, 2022

ok this technology is going to be used for evil but if you are smart you can just not fall for the scams right?
but the responsability is of the user
we should make a religion out of this

@Duttenheim
Copy link

Well, ban cars, weapons, hunting, the Internet, computers. you wrote such nonsense. technology will develop, but without you. on the contrary, it must be developed. it was created for entertainment, and if a person uses it for other purposes, then let him answer for himself, it’s not the technology that’s to blame, but the person, not the machine gun, but the person. learn to recognize technology is my advice to you.

Why does it have to be developed? That argument is just progress for the sake of progress, no matter what damage it might do.

@chervonij
Copy link

Why does it have to be developed? That argument is just progress for the sake of progress, no matter what damage it might do.

Philosophical question. Why should anything be developed at all?

@MysteryPancake
Copy link

MysteryPancake commented Feb 23, 2022

This issue is more relevant to DeepFaceLab which is responsible for training and face swapping, whereas this page is just an application of DeepFaceLab

@Chopin68
Copy link

insteresting

@Duttenheim
Copy link

Why does it have to be developed? That argument is just progress for the sake of progress, no matter what damage it might do.

Philosophical question. Why should anything be developed at all?

Because it might provide benefit? And some obviously don't? You have to consider there being nuance in everything, including technological development, unless you're going to be willing to do anything for the sake of progress.

@zyzstat
Copy link

zyzstat commented Mar 22, 2022

I'd never seen St Maria until I find your words.

@0614050125
Copy link

Technology does not involve the problem of virtue and evil. appreciated to the warmhearted and talented author. I just want to ensured whether exist memory leak in S3FD face detect module. The other two default module YOLO and CenterFace don't have this issue.

@StefCoders
Copy link

Mark Zuckerburg is not a robot he is a robot with a deepfake on it

@GildedHonour
Copy link

GildedHonour commented Apr 21, 2022

Even a dick can be used for evil purposes - to rape someone. And vagina too - to try to seduce someone in order to then put him behind bars. Should we ban dicks and vaginas?

@Duttenheim
Copy link

Make that argument for the nuclear bomb. I am waiting for the good side of those.

@naddika
Copy link

naddika commented Apr 22, 2022

Very easy - if not the nuclear bombs, some countries that have them, would've long been invaded by some other countries. As a result, many people would be killed and suffer.


The topic reminds me about covid-idiots who suddenly have started to assume that there's only ONE and only ONE dangerous virus in this planet -- covid-19, aka little flu! The only one which must be dealt with. And who neglects THOUSANDS of other viruses that've always existed and will exist, live among us, and which too have killed and will kill people. Let alone thousands non-viral induced causes of death.

Therefore, forget about thousands of other threats and let's fight one threat which has suddenly become more important that others.

@lemontree-hub
Copy link

lemontree-hub commented Apr 23, 2022

Opponents against this technology, please first read the paper containing the authors' (DeepFaceLab) thoughts.
https://arxiv.org/pdf/2005.05535.pdf

The authors say:
"The best defense is a good offense."

There have always been crimes such as the misuse of the technologies even before this technology was made public. I totally agree with the thought that it’s not the technology that’s to blame, but the person.

As a researcher and developer, I would like to thank the developers and the researchers who have contributed and made this technology public. This technology could be used for more useful purposes, such as defending against counterfeiting or adversarial attack, and more.

As the authors have mentioned in the paper, research on media anti-forgery detection is being invigorated and dedicating growing efforts to forgery face detection. Training robust forgery detection models requires high-quality fake data. I also want to contribute to this technology so that it can help people who really need it.

@Rainb0wCodes
Copy link

Stop developing telecommunications technology! $30B are lost every year to phone scams! We should just go back to the forests and live like monkeys.

@anoncam
Copy link

anoncam commented Jun 11, 2022

It's either developed in the clear and open or it is developed way deep in the dark. Pick your poison, it's great this is open to review code/data sets and analyze tactics procedures, and protocols of malicious activity and the actors performing it.

@chervonij
Copy link

@darkworks
Jesus. Where do they breed you inadequates?

@brokeDude2901
Copy link

This technology is only going to be used for evil purposes. To deceive people, steal their money, possessions, undercover operations. Nothing good. It is already being used for scams like the pig-butchering plate, in which hundreds of thousands of lives around the world are being left without money, causing a lot of suffering.

Please. The world ain't sunshine and butterflies.

@anri-asaturov
Copy link

anri-asaturov commented Feb 2, 2023

What you afraid? Fake news? You can watch it everyday without NNs just watch "Rassia Today". Or porn with your face? Better if everybody understand that even school boy can create deep fake video and soon almost everybody be sure that it is likely fake. You can only help defend world from deep fakes if create new open source NN for deep fake detection.
@stilletto

Any argument that sounds like 'any .... understands that' is invalid, even without deepfakes you make any accusation loud enough and half of the people will believe you and will never read the debunking. Just look at flat-earthers :-D

Seriously tho, do you really need examples of what could get wrong if anyone can look and sound like anyone they want over internet calls?

Also even if you are smart enough to recognize a deepfake, your bank account manager, for example, might very likely not be that savvy ;)

@stilletto
Copy link

You can only help defend world from deep fakes if create new open source NN for deep fake detection.

So why does this repo specifically boast about avoiding detection?
May be to push somebody to make it better?
deepware.ai need to upgade software if even this can avoid detection.
Once I used dating sites and various scammers constantly wrote to me. Some even made videos. Even without such software. Usually I quickly realized that they were trying to deceive me. Then I made my own dating app and saw how easy poor African scammers need to deceive a person who wants to be deceived. Usually it was completely stupid. Perhaps they need such software, but they do well without it.

@Asmageddon
Copy link

Think of the elderly, of the non-tech-savvy, of children, of people too tired to remain vigilant. You can not put the burden of identifying deepfakes on them. Lives will be ruined. The easier this stuff is to find and setup, the more so.

@devjev
Copy link

devjev commented Feb 2, 2023

You can only help defend world from deep fakes if create new open source NN for deep fake detection.

So why does this repo specifically boast about avoiding detection? May be to push somebody to make it better? deepware.ai need to upgade software if even this can avoid detection. Once I used dating sites and various scammers constantly wrote to me. Some even made videos. Even without such software. Usually I quickly realized that they were trying to deceive me. Then I made my own dating app and saw how easy poor African scammers need to deceive a person who wants to be deceived. Usually it was completely stupid. Perhaps they need such software, but they do well without it.

OR (and hear me out here) you could just write better detection software without needing to develop scam and revenge porn tools.

@shaunsingh
Copy link

May I once again mention (by the same authors)

These content generation and modification technologies
may affect public discourse quality and infringe upon the citizens’ right of portrait, especially given that deepfake may be used maliciously as a source of misinformation, ma- nipulation, harassment, and persuasion. Identifying manip- ulated media is a technically demanding and rapidly evolv- ing challenge that requires collaborations across the entire tech industry and beyond.
Research on media anti-forgery detection is being invig- orated and dedicating growing efforts to forgery face detec- tion. DFDC4 is a typical example, a million-dollar competition launched by Facebook and Microsoft. Training robust forgery detection models requires high-quality fake data. Data generated by our methods are involved in the DFDC dataset[5].

While this may currently avoid detection, the generated images are being used to train detection software for the future. "Better detection software" isn't magic

@amicus-veritatis
Copy link

amicus-veritatis commented Feb 3, 2023

I don't think this discussion would be going anywhere or actually manage to convince contributors (+ potential contributors) to stop contributing to this project. If there are people who want to restrict development of this sort of technology, it might be better for them to write to their MEP/MP/congressperson than make an issue on a github project.

Also I believe there are laws against malicious use of deepfake already, including in EU and Spain.

@Trendyne
Copy link

Trendyne commented Feb 3, 2023

In case it comforts you at all, I am 99% sure that bioengineering will breed us into complaint human ants serving a bunch of multi trillionaires before AI has a chance to do us much harm

@andrew-phi
Copy link

We rather need a strict license that would explicitly FORBID WEAPONIZED USE of software against humanity.

@iperov
Copy link
Owner

iperov commented Feb 5, 2023

@andrew-phi read existing license.

  1. Disclaimer of Warranty.

THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
ALL NECESSARY SERVICING, REPAIR OR CORRECTION.

  1. Limitation of Liability.

IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
SUCH DAMAGES.

@ROBERT-MCDOWELL
Copy link

up to each human to be on the light or darkness side.... but don't regret if you chose the wrong one!

@nilsnh
Copy link

nilsnh commented Feb 7, 2023

Not sure if this discussion is going anywhere but for the bystanders I'd like to add the full version of the quote by Melvin Kranzberg that's often only quoted partially:

"Technology is neither good nor bad; nor is it neutral."

If you subscribe to the idea that technology isn't neutral and some are more useful than others then you might find ethical source interesting.

@rollorx2
Copy link

rollorx2 commented Feb 10, 2023

To everyone claiming that this tool is somehow important to counteract the negatives of this technology:

This repo is almost a year old, 320 commits in, 37 releases and exactly 0 mentions on how to actually counteract malicious use of this tech.

At this point, a fart is more credible than any such arguments.

@devjev Lets try to bring some crediblity to the discussion then. Having a background in allied health I can see many uses for this technology in speechpatholgy. Having an avatar identical to the patient that can be accessed 24/7 that helps retrain and/or correct speech patterns that the patient has full customising options over has the potential to revolutionize an entire medical field. I could see this easily extending to physiotherapy, exercise science. It could offer someone who is nonverbal, the first chance to participate in online chats with their image, speaking, mouth moving forming words along with verbal speech, based on typed text or interrpreted sign language.

When the technology is perfected I see every movie updated to be available in every language. No subtitles or dubbing. Then from there every video media resource on the internet. Maybe years from now we will all take for granted the checkbox in youtube that reads "Play videos in local language", or whatever language you feel like, perhaps you want to pick up a little Russian or Chinese (because its a good idea ;).

For me its quite easy to see where this technology will benefit. Just be open to the possibility, there are bright, intelligent people that care about humanity and want to see it thrive, but they cant create if you deny them the tools they need.

I hope I have added some credibility to the discussion, but I fall short of providing any support that the above will somehow counteract malicious use of the tech, but I will say the examples I have given have a far more qualitative nature as Im not sure I can put a "value" on things like the potential of having "all" media available in "all" languages, or what cost a mute person assigns to their vocal cords. Yes people will and are being scammed, I think the biggest one was the Elon Musk crypto scam. In my opinion, deepfake wasn't the driving factor here, it was greed. If we are to find solutions, we have to look honestly at our problems.

@ROBERT-MCDOWELL
Copy link

ROBERT-MCDOWELL commented Feb 11, 2023

@rollorx2 well dude, do you see any intelligent people ruling this planet? I see more a kind of international mafia conglomerate with secular plan to enslave humanity and worse modify its DNA to be perfectible servants. Go back to reality and see what you lived since 2020 and think twice about your link to reality. This said, and as everytime there is a technology evolution (as the time of the knife be invented) it's up to each human to have the consciousness to use it for good (GOD) or for evil (destruction). that's why restriction and repression are not a solution, but education and training of consciousness following the rule of Life and matter are crucial for today and next generations.

@rollorx2
Copy link

@ROBERT-MCDOWELL Don't worry yourself with what your WEF draco overlords have planned for you. Complain less, build/create more and you win.

@ROBERT-MCDOWELL
Copy link

@rollorx2
not a complain at all, since 2001 I ignore them, it's just a warning for developers here who still dream about a selfish world with competition and no spirituality

@devjev
Copy link

devjev commented Feb 17, 2023

This thread just keeps on giving and giving.

@andrew-phi: We should forbid the weaponized use of this tech through licensing.
@iperov: Don't you worry, I explicitly waive any responsibility in the license, so I'm good.
(@rollorx2 burst into the room)
@rollorx2: Let me bring in some credibility by confusing my own opinion with evidence.

Excellence.

@GeorgeMD
Copy link

So it's been exactly one year since this issue was started. Mrdeepfakes still listed as one of the top communities. No community seems interested to use this for speechpatholgy so doctors can have an avatar identical to the patient that can be accessed 24/7. Hey @rollorx2, since you have some experience with this, maybe you can start that community, maybe it will be bigger than mrdeepfakes, you know, so this has some credibility.

And about learning russian and chinese, let's see in a few months how important russian will be. I'd pick up on some ukrainian.

@rollorx2
Copy link

God willing! @GeorgeMD … or, Zelensky could use it to keep up with his Golden Globe/Oscar appearances and speeches across the globe, which would free up his mouth enough for every western world leader to enjoy.

@timodaxia2019
Copy link

强力支持开发者开发出这么优秀的工具!好的工具用在好的地方!恰恰是像楼主这样的,内心肮脏,才会把这么优秀的工具想象成为龌龊的东西!还有一个原因,是因为这款工具的开发,牵扯到某些人的自身金钱利益,这些人本来可以通过这个技术形成技术壁垒,收取高额费用,没用想到的是,开发者居然免费分享!——这是有些人对这个工具恨之入骨的原因!

@stilletto
Copy link

强力支持开发者开发出这么优秀的工具!好的工具用在好的地方!恰恰是像楼主这样的,内心肮脏,才会把这么优秀的工具想象成为龌龊的东西!还有一个原因,是因为这款工具的开发,牵扯到某些人的自身金钱利益,这些人本来可以通过这个技术形成技术壁垒,收取高额费用,没用想到的是,开发者居然免费分享!——这是有些人对这个工具恨之入骨的原因!

Good words, may be you right. Demping for them. As "find face" tech annihilate anonimity in internet, now this tech make strong protection of your anonymity in way anyone can make porn within anyone face. So blackmail of onlyfun models now not so easy. Anyone can say it is fake and no mater real it or not.

@dnoiz1
Copy link

dnoiz1 commented Mar 29, 2023

image

@devjev
Copy link

devjev commented Mar 30, 2023

God willing! @GeorgeMD … or, Zelensky could use it to keep up with his Golden Globe/Oscar appearances and speeches across the globe, which would free up his mouth enough for every western world leader to enjoy.

Jesus Christ, one would think that this repo couldn't get more incel'y.

@devjev
Copy link

devjev commented Mar 30, 2023

So it's been exactly one year since this issue was started. Mrdeepfakes still listed as one of the top communities. No community seems interested to use this for speechpatholgy so doctors can have an avatar identical to the patient that can be accessed 24/7. Hey @rollorx2, since you have some experience with this, maybe you can start that community, maybe it will be bigger than mrdeepfakes, you know, so this has some credibility.

I'm still holding my breath. :D

@Pros12am
Copy link

Cool I'm with that

@Currency1r
Copy link

I'm totally for your skills in technology keep going 💪 take us to the moon 🌚

@DarioFabian
Copy link

Sir, I wish you learn the hard way then the misuse of technology. If you are not capable of reflecting in the slightest, you are a cynic who will have to learn the hard way.

In the meantime, know that you have my absolute contempt and you must know precisely what your technology is for. To destroy life and plunge 80-year-old grandfathers and grandmothers into poverty. In your conscience, if you have it, it will remain.

This time it was my parents, tomorrow who knows, it will be theirs, or those of someone they know.

But what the hell, they should have recognized that they are fake faces, right?

So you should destroy all telecommunications technology? Thousands of dollars are stolen every year by scammers from all over the world through fixed and cellular phones... You should also destroy gift cards and prohibit sending money to unknown persons, as well as bank transfers....

@DarioFabian
Copy link

Well, ban cars, weapons, hunting, the Internet, computers. you wrote such nonsense. technology will develop, but without you. on the contrary, it must be developed. it was created for entertainment, and if a person uses it for other purposes, then let him answer for himself, it’s not the technology that’s to blame, but the person, not the machine gun, but the person. learn to recognize technology is my advice to you.

Why does it have to be developed? That argument is just progress for the sake of progress, no matter what damage it might do.

Here are some examples of how you can use this technology for good:

Helping people with facial disabilities to have a more "normal" appearance.

Help people try different hairstyles, makeup or even plastic surgery before making permanent changes to their appearance.

Help people protect their privacy by hiding their true identity online. For example, for people who fight against scammers (like Scammers Payback) it would be useful to give more credibility to their calls, complementing the use of voice changers.

@Faultless
Copy link

"Guys this tech can be used for good as much as for bad" lists 3 fringe examples while 99% of it is used for coomer content and scam development. Yea bros this is the same as telecom tech or gift cards, totally.

@DarioFabian
Copy link

"Guys this tech can be used for good as much as for bad" lists 3 fringe examples while 99% of it is used for coomer content and scam development. Yea bros this is the same as telecom tech or gift cards, totally.

The simplest use that can be given to it is for fun and entertainment, that is what most people use it for.
You have your attention on the evil side so you can't find any other good reason to develop this technology be yourself, then the problem is yours, everyone gives things the approach they have inside them.

@tuapuikia
Copy link

We should also ban Tencent from providing the face swapping service to the public. Technically, we should prevent humans from advancing and encourage them to stay in their current state. Hollywood should stop using deceased actors or actresses in movies.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests